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study; Projo^dt Head Start 



- .irhis- tdpott presaniis the findings froi^n evalaation 
^. ' 6f/€kd classrooB processes. o£ t'ho twelve planned Variation sponsprs. 

' .three ba^ic issues vere aMp®^^^^ the ^ 

' prograas really' ^iief brenVahd providing distinct treataents? (2) to. 

what extent are the edi^cational g.oals Of eadh p'rogr^ aOiuallj^ 
' iBplesentedr and (3) is there a relatioiiship between igpleBentation. 

and child oui4^oi,e as Measured by cognitive tand liChieve^eht tests? 
• After a brief overview of PrtiJect Head start :<^d descriptions or each 
sponsor iodeli^ th*e «^t>od of the Valuation st»dy . is discussed* pata^ 
, coiieTction was based. V^^^ of iests adiinistered in the early 

fall and late sprih9^(,of ' the 1970-<7l acadeiic year^ an4, ol>^servatiai^ 
of <^la$srooa prr)cesses twice during tha^t saiie^^^y^^ Xh.e obsetvati^bn 
instiiiiiients and li^^ of tests used are ap|>€mded' to thb docuvent* The 
< . procedures of analysis for the study i(coi|>uter and sta/tisiic are 
N^lso discussed. It is concluded -that (1) althoucih severajb iopse . 

clttsteri of _sponisors were idefthi^ied* there* we*:e «ore j^l^4il4H 
~^*^iiWHft--4^ consist^cy bet¥eei;k- sp<>nsor objectivbs and 

■' sponsor f rbguehcies on th^^variablesi #elected to reflect tlieM 
; bbjecftives iihs guite high for ^1^ but consi^il^ency bn tjiese 

^'aae process variables across sites wa^ ^iuite' low, and/ (3) the 
- relationship between' ii|pl<^aentatibn' and test results rfiains upclear. 
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, .1. INTRODUCTION ' , ' 

. ■ , .■ > ■ . ■ :. ■ ■ . ■ , . . ■ , 1 .. ^ < . . 

The Head Start* preschoor child development progrfirii was established In 1965 
as an educational and, soglal services .Intervention program intended tb'ertrich the 
early environnSent of children of lovv^comd fanxllies— a disproportionate number 
01 whom had an ethnic nMbrity backgi'oand*;,^^ ' • ^ 

As one of several programs established to wagD the War on Poverty, .Head • 
Start (HS) was viewed as a way to increase the Ukelihodd thai succeeding genera- ^ 
tions of children would not be harn^i^sed tqjf life of pover^v.. It was felt that pro- . 
vidihg socipcfconomlcally disadvaM^ged young children with appropriate preschool 
experiences \yould equalize their chance of school and life success with that of 
ti^elr more fortunate peers. The goals were to provide the children with pre- 
school experiences as well as social and health services that would prepare them 
^ for the scliooljvorld afid' the intellec'tual t^sks required of them . The classroom 
pr(^rams .were established at. the local level and reflected community. goals; on- 
going jfe (feral help and guidance were given ^but' without prescribed content and 
method^. - ■ ''■ . ' ' . t 

LateiT several IhVeWligators whoiiad^le^Glbped piv^ch^ra 
on varying.educaitional.smd developmental philosophies and usfng different methods ' • 
targeted to socioec(5n6micallj^'' 'disadvantaged chil<lrenr-wer6 hivited to extend their, 
programs li\tO Head Start Centers in ccJmmurfities in which thfey already sponsored! 
FbUow Through classrooms. In order to determine Ihe relative effectiveness of 
some of these apparently distinct programs,- the federal government contracted* v"§5 

^ with the Stanford Research Institute to conduct a study of eight (which later In- 
creased ^to 12) of these "plannjeJ variation!! programs.YThis report presents the 
ffnBIngs^from tin evaluation of the clasSrbopi processes of the Planned Variation 
sponsors. The report Is concerned with 4ps^ssing! (1) the d^ree to which the 
programs {ire indeed different— that is^ were' they distinct treatments? (2) the 
extent to which the educational goals were implemented; and (3) Whether there is 
a relationship between implementation and child outcome as measured by cognitive 

_ and ^tchievenyeh't tepts . -^This chapter; presents a summ^ the background that 
led to the establishment of the HS program and the HS Planned Variation experl- . 
ment, as well as a brief introduction to the meUiodology of SRI'ys olassroom ob-- 
servation. study. \; ° ' 



♦The statutory kuthority^for Operation Head Start was tlie Economic Opportunity 
^ Act of 1964, PL 88-452y / - ; ' 

^'^Sponsors'* arp developers of preschool programs, called Vmodels^', fot use in 
. Head Start, The rolationWip^^l^^ intellectual or pedagogical leather than fifiartciaU i 
^ "sponsored': classroom Vs ohe jn which ti '^modeP' is being usfe^* A ''n6n- 
nsprdd^^ qlassrqom is c^^ H0ad iStart or Follow Through 

withpufthe Influence pf a sponsor's model. Ihitially; eight sponsors wete involved, ■ 
but\thls numbot \vas increa^^^ 



Backgi^ound ^ . . * : ^* 

^; ; The establishment of Ojieratlon He^d Start ifesul ted rather directly from * 
President Kenne^^s panel cm menial retarcktlon that recommendeid, in 1963 , an 
intdrvehtion program to preVertt ihlld tnenttiti retardation . Since thb^ majority of 
the mentally retarded ejthlbit no k^^ physical;cduse, andlsilrice 

appr'oximafely 75 percent oL-those -in^vlduals are found amohg the sooibeconomi- 
caUy disadvantaged segment of the sociefy, the pane) felt that an aipproprlate' early 
childhbod program might prevent such retaliation ^ Subseque^^^^ panel of 
experts prepared f^d^^^^^^ proposing a dhild development program (qf the 

nation ^s 5, 8 million socioecpnomically disadvantaged phildreh un(Jer,^slx yeirs of ' 
age. Thus Operation Head Star ficonomic Opportunity Ac^; of 

19(54 and become operational in 1965. / ; ^ • ^ 

theoretical: Bases for Head Start . - . / i ; v • 

, ^Although several disparate eye^^^^ and cii'cumstances led lo the HS program, 
the one of immediate relevance to: this report was tfie evidence accumulating from 
biological ahd behavioral research into the plaslicity of developing organisms and- 
the importance of the eaply years ^n a chllcUs development. Earlier If had been 
thought that Intelligence iVas biolog^^ fi^ed ^d twat its developmeht was a 
matter of maturation, largely Mnaftec ted by life circumstance; but new evidence 
frpm anini^Ji and hujjian stud^ studies documented 

;lhe ill effects of stimulus id^^ mental *- 

development. Furthermore, sociological treatises referred to a';*culture of ^ 
poverty^* and /'cultural deprivation'' 4s operative ampng^ groups, 
these research fin'dfngs--together the early pres^^ studlesV 
the syntheses of psychological evidence, and developments in pr School edu^aU^^ 
led to the exjiectatiph that early edi^cational programs, .puoh a^ HS, ;^could Oomperi 
sate^for these presumed depr ivatlo^ns . Histor ically f the studies o)f sensory depri- 
vation go l?ack a long / ^ \ ; 

- ■ ^ ^ . ' 1 ' . - ' ' ^ ^ \ \ ' ' - " 

Over a hundred years ago, Sechenbvl*, the famods Russian physiologist, 
emphasized the critical role of sensory^tlmulation in all'behavlor . Sensory 
activity, he maintained,: was essehtlal to the preservabon of llf^ itself. 2 In the 
U.S. , highly controlled experiments^ with ribn^human subjW since 1945 have 
demonstrated a direct, basicaUy linear, relationship between the variety and 
complexity of early; environmental stimulation and later task per for mance and 
adaptive social behavior . Thrill effects of the absence of ai^bropriate early 
stimulation were noted in human studies as well.l^"21 TJ^^g^v^ early 
assumption that chilch^eh were jieprived of varied arid comp\ex\stimulatlpn and 
thereby not developing to their optimal <j^pacity, Head Start expected to pro- 
vide a stimulus-rich environment .that would compensate for th^ early in-hdme 
deprivation^ \ 



*Referenc*es are listed at the end of this tex^ V, 

tsee, for examp^les, these studies; with rats, References 3,4,5; with dogs and 
\ 'cats, Referenbes 6,7,8^9, 19i with sub-human primates, References 11, 13*13, 
14, and 16' 



-Ad^ltiprial early studies suonor ted the {ireschdol intervention hypathosc/s.v 
The 1930 Skeel? and Dye stutli'/^ and M follow-up 21 year^ later ,2^ provided 
^Iramatic evidence of the effect of environment on human^c^^ Other 
studies Included mwe^s/dembn^ effect of spec inc ilanguage tr^ 

; and enriched experiences/on intelUgence as measured by the Statiford-Binet; • 
Kirk^s five-^ear stuc|y^^\0f 81 mentally retarded preschool children whTrivoio^ 

. tutorpd inipx^rams specifically tailored to fheli' md^^^ diagnosed menial 

oapucltles} an^ Stroclj^be^j'k^s st^c^y23 of five groups of mentally retarded or or- ^ . 
phanqd black bop y Who ,\ver^ placed m permis$ive nUrsery school programs 

or more stru(^ttfrcd 0^ to be more effective than the ft^rmer. 

.^^^^ to the concept tliktrhumun intelligence is not fixed but 

depends or); the intex\icfioi> between* genetic potential and life circumstance were 
three inn|iiBntidl treaty Hel)b,2^ Huht^^ afid Blodri^-^C Hebb^s The - 

Organisg^tion of Behavior ?^ adyanxiecV the theory that there ar6 t\Vo dlstinct^stageS 
of learning ; f ir s t , the qual i ty^ tmcl extent of a person^s earlieigt an^ continuing 
perceptual ekporiondes will detpriiiune how Yiuic in his heui'Qlogical 

bank; and second, the^^q^^^^ df-his learning will depend for efftciency^nd the level 
of function on the richness in b6th quantity Hnd quality of whdt is stored ii^that 

Hebb's with the stimulus, deprivation fJndlng^K Hunt> 

in his Intellifi:ence and Experienced '^ inferred from the considerable evlden<ie from 
animal and human stucties tnat the developnien£\o/ intelligence Is dependent upon V 
the interaction between genetic* potential; and th^ quality and nature of experience, 
Bloom^s monograph Stability and Change in Human Charac^ter istlcs , prp'sented 
the conclusion. that the rate of intellectual developmentjs greatest in the Varly ^ 
years and teaches relative sUibillty by age 12 , and that it is most easily modified 
during the period of its most active growth.' ? / 

- The ^tudiesjiientioned ear Jier and the stated yiebretical constructs'may have 
influenced several iriyestigators indepehdently^^^ develop presbhool intervention 
programs/for socioeconomically disadvanta^^ These included the« . '\' . 
Gray and Klau?^ ( prog^r^ X)eutsch»s New York \" 
City preschool and e^rly elementary school programj^S and Weikatt^^ program^S N 
in Michigan for black children diagnosed as mentallyTiet^rded due to Vcultural 
deprivation// These and other inyestigatprs provided early evidence that cai^e- 
fully de^jgned programs with langU|Lge and cognitive components have ^n impact 

on the learning capacity of these children. ' \ 

The more recent re^eax^ch and evaluation studies have been valuable Ift re- 
vealing the inadequacy of soin^ df the earlier aissumptions, Clearly , ecdnbmically 
disadvantaged chilcjren are neither ciilturaUy nor stimulatively deprived perXsei. \ 
.However, they inay have nutritional deficits and unattended health problems A < 
they may liye in ah environment with an inappr1)pr iate s tii^iujus level (too mucjh, 
noise, activity, and so on/ and too highVexpectation^); they ofjen have dulturalV 
bacl<grounds different from the mainstream culture on^wh}ch the school system ^ 
is premised; and, most impprtaht in terms of HS goals, they ^^m lack the speci- 
fic types of aflult-chnd interactions and experiences Jthat^ Would prepare them for 
success^ in School and later adulthood in a highly organized^ industrial literate ^ 
society * -Head Start pV6gram.s w ere formulated to provide domprehensiVe social 
and health services to the Children and their families 'as well as. an enriched pre- 
school* curriculum the expectation that the effprt would umeliorate such 
conditions where they existed. ' . 

\ ./^^ : ^ ■ V / .■ , ; ■ ' - ' *■ } • ■ .. 

- ^ ■ - ■ ■ \ ■ . " ■:-3 ■ ; ■ / / . ■ ^ 



i^lBiilffiiiiSli*^^ 

r-VC;7 V.V ■ v'"!^^^^v^^» ^*^®oK®^"*^ from an early eyalufttlbh of the initial Uead S^rt ■ S^ 
Wr/yi'^^ ^'li^!^^ program^o wero imrji&dtately 6ob.ering; The findings Indicated tfrat N*ha(^ '/^ : 
• ■ '"oveip gMhs.the ohlltlrw had made in the first summer df HeiJid Stixr t wete hbt ' ' : . S.', 
^ ■ i . maUjtaihed at the end of .kindergtwbn^ these findings supported the.oplnlon of * ' 
i't-^ f^;^om© ^lld development Speolallists that a summer. prdgi'am was ioo4!s^(iai*tii!^:-.iili|^ 
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too lato In theltf lives. 



jltf lives. In addition; there was^th^ question ofnvhether the traditional 
public school klnd;6rgar ten and early gyade progframd were suffioi^ntly apprbpii^lftte Ml 
to the needs <?{ th-i&se chlijdren to maintain or accelerate their school progress T the " 
result was the.establishn^ent of: (IJ fu|I year programs' for HS children; (2) Parent- I 
Child, Ceftlers fpr children under throe years of age and their parents; and (3)Hhe 
Follow Through prbgramithat maintain^ an onribhod prograim in kindergarten 
, thia>ugh tho thlrrf grades i ^ * " : ^ ' ^ 



. As the oVlgi^ial rationale of the prograTO was modified ajid becante more 
sophisticated, Head Start evaluations no longer attempted to determine ^hV; 
effectiveness of a short-terni Inipaot that was presumed to make dis&cjvahtaged 
^children equal/at school entrance to middie-classvmplnstreahi children on rail 
performance mea^sures and^us, presumably equal in educational opportunity, and ^ ' ^ 
'*ljife chances J' Instead, Head Start research and evaluation has become a n\uUi- ' 
focused searph for ways to maximize sh6i^t- and long-term Impacts on different ^ 
criteria df chtld growth and development. These Ipiclade thg Parent and.Chlfd 
Center studies Xo detei^mine the'effects of working with children even y^ounger 
. than lle^d jStartxhttdren and their, families ; the Follow Through experiment to , y 
determine the effects of-a coherent pyograim of continuous intervehtion thi^Oughout 
the primary grades after a He^d Sta^j^ekperlehce; and Sstudles of th* effectiveness, " 
' Of Health Starts Home Start, aifd qthfV early ^ch^dhood prograWs, , - , / 

;/:More recent evaluations, ^^^^^ which re-examined the Original Coleman et\aK , 
study;^*^ have Jtprided to challenge the assumption that equalised access to:booksy 
mote experienced teacher^; wellrequ^ipped so^ience laboratories^ 'and so on, result 
in eyqualiased student achievement* ' The JenCk^ study also challenged the a^StAnptlon 
that equal educational atK^inment Idads to equal {middle/Upper Cl4ss) 'sbcioeconoiiilo\ 
status, These. several assessments continue to point (k>%K6 s^clbeconomlo* status \ . 
of the family as the critical factor in a child's School and life success. However ,\ . 

. these evaluations rely on factors that are quite distant from the^^ctual activities \ 
in the classroom. »The classroom observation stut^ was implemeltted as part of a^ C i 
'^latihed variation'* ej^periment to determine\whether thb clSs.sro6m,f>'f8(i&ss, as { 
defined ly ajpeciftc curri culu m, makes an' lihpact on child oajtcome. The planned\_ 

" vartafloh experlment,^^^^^^ determine whether the sever^il^ 

types of pxveschool programs were indeed distinb^. treatments, ^nd to explore their ^ 
relative effectiveness. \ . - — ^ 



Head Start Planned yarlation St^udy \^ ?^ 

/ 'WhQn it'becai*^ clear that sheer stimulus ^ei^ridhmentor^rly lntctve^ 
was noi a unitary treatfttent variable and, that the. mechanisms involved In such 
vggnieraV enrichment are poorly understooyf, the Head Sta!rt and Foilo\v^ Through \ 
Plani)ed Variation experiments were initiated, Heajl Start Plamjed Vaf iation(PV) 
svas Conceived as ah evaluation •bf Vthe impact ipf varioil's well-defined educational 
environments and learning situations on the Head Start child. v34, U wlis plercCived^ 

;.■ ■ ■■■ • . ■.. - - ■. . .V,1J.:.'- 



as an experimoht in which classroom curricula, or j^iodols, were seen as treat- ' 
liients fo be .Implehientecl in several/sites, with each ^itd being 6. replloatton bif ^hd*: 
.^eatment. ' The sai'Classroom Ob^^ervntlon Instrani^nt ^^s one of the principal . 




, models and with non-sponsored Head Start." 

* The core of.tho planned variation stutjy iis the original taight— Increased in- 
1970-71 to 12 —pre^developed preschool progt'am^, selected because they appeared 
tp provide distinct cur'ricul^' based on divergent psychploglcal and developmental 
theories; These programs ar^' referred to' as "models", and their or iginardevel- 
ppers are called "sponsors." In 1969-70, the eighj sponsors had programs 
located at 15 sites; in the secoitd year of tlie project*, 1970-71,' the. sponsors had 
been Increased to 12, with programs at j37^ites (seie . Table i)v Two of the 12 
models, the Enabler and Florida models;/^o not h^Vo a developed classroom \ 
curriculum., . The' Enabler model (five sites) provides a^i early childhood education 
expert who visit^s a given site regularly. and.helps the community. develop its cur- 
riculum and program i|i terms oi fts/own goals for the children.,. "'jThe Florida 
model (four sites) 1s prlmarilyti home intervention model; SIrfce it Is based on the 
view that the parent Is the primarjf educdtor of the child, trained parent educators 
teach a parpnt (usually the jtiotheT) 'to educate the child and aid the parent in pro- 
vidhig an educationally enriched home ehvirdnmeiit. / ' 

The aim was to locate these ;ispons^reU Head Start programs In communittes 
that already had a sponsored Follow Through, prograpft in the local elementary 
^ schools so as. to tatce advantage of ^rh^ lorigitudihal Aspect of the Follow Through 
' ^ evaluation. These Head Start ^ites' adopted th^ mdde^alreac^y; Joeing implemlented 
in the Follow Through classrooms. .Fourteen hpn^sppnsored Head Start. prograpis, 
located either in the s?imesiteas the sponsored U6ad Start j^rpgrams or in nearby 
oonimuntties, wero select^dcas comparison prol^^ariis tor Ih&Vtudty* (A site is a 
Head Start center or group of such <!fenters geni9raUy found in the same iPc^tion* 
and acbiiTnist^ered by one agency*) All the planned variation classrooms in '^ stte 
'useHhe same model. The sponsor is responsible for only those classrooms that 
* are using his mPdeL There were ri^ ^Pn-Head Start comparison classrooms in 
the stjAdy: aU;classrooms w6reJlead^S ' 

The staff of a mpdel cli^ssroo'm Is eiipected to teatfh according to the spon- 
._^aciS.4^^JptiPn^ either learn ; 

new or tp modify their own teaching teohniiques-, ways of relating to childrenv and . H 
w?iys prdrg^iz^g the classroom 

* ' DescHptfon of Sponsor, Mgdels- ^: ' 



.- Brlpr desPriptipns gf Uiej^a^ niPdels are pr|&sented below, 

^ Far yfest Laboratbry (FW) 7^ ^ ' • 

Th^ prlncipc^lAim bftlje PaV West LalwratPry^ is tP develop within 

thP chil^'a poslMV^ jSeI^M^iag:e^ to search out splCif iPfts to his ^wn * ^ 

probrems.A^^ program is based ort tAe autoteUc discov approach, i.e. , 
learnVtg a'ctlvitie;s are struotured to be self-rewarding»ahd to help thie child learn 



' HEAP START PLANNED VARlAtjQN SITES: ,1969-1971 



Sponsor 



1969-70 



l970-i7i 



Far West Laboratory 
(FW). 



Universlly of Arizona 
(UA) 

Bank Street Coll ege Of 
£du<jatlon (EC) 



University, pf Oregon 
•(UO) 



University of Kansas 
(UK) , 

flligh/Scope (M/S) 
University of Flori(ia^ 



EducatlPn Development 
Cen]ter/(EDC) . 

University of Pittsburgh (UP) 

-ilesp^nfeWirEnvfironiTient"p^ 



Comparison (flEC) 
New York University (NYU) 



Duluth, Minnesota Duluth, M(nnesota 

• ' 1 Fresno, California 

' , Tacoma» Washington 

- : ' Salt Lake;City, Utah. 

Buffalo; New York 

LaFayette, deorgia 
Lakewfifedi New Jersey 
Lincoln » Nebraska ' 
\^tuskegee r Alabafn^^ 
*WiMington» Delaware 
rBoulder I Colorado 
Elmira, New York 

Tifpelb, Mississippi; 
East St; Louis, Ulinbis 
East Las Vegas, ^ 
New Mexico 
OraibJ, Arizona 
Portagbville, Missouri , Portageville, Missouri 
, ; : 1^ ^ iVIounds , Illinois ^ * 

Ft. \Vaitori Beao^^^^^^ Beach, Florida 

Central Ozarks, ; . ' ' Central Ozarks, Missouri 
Mi9s6urf ' ^^ Greeley; Colorado, 

' Seattle, Washington 
Jacksonville, Florida- • Jaoksonytlle, Florida . 
Chattanooga, Tennessee Chati^ooga, Tennessee 
; ^ - j;onedboro^Ai^kansas 
Houston, ijexas 

iVashlngtpn, Ef,C\ Wfiishington, D,C. 

johhston County^ Patersoh, New Jersey 

North Carolina Jotnston County, N;C . 

Lock HaveHj Pennsylvania 
^Kansas cuy, Missouri 



LaFayette, Geprgfa 
Lakewood, New Jersey 

Tuskegee,^ Alabama 
Wilmingfbn, Delaware 

Tupelo, Mississippi / 
East St« Louis, Illinois 



Oraibi^ Arizoni^ 



if 



Enabler Models ^ 



St. Thomas, \ . 
Virgin Islands . 

Billings^ Montana - 
Colorado Springs, 
Color 5do 

bMIows Falls, Vermont 
NewbOi^h, New York 
Puerto Rico 



skills, concepts, and attltude^.thrfl will enable him to a'pply his knowledge in new J 
sitUv^tions. The environmental struotm^e Is intended to respond to the, chlld^s 
own needs ^and Interests. Adults in the classroom provide feedback and guidance; 
they, are ^^esjionsivb but not directive* , * 

University' of Arizona (UA) . \ - > * . 

• . ' ! The curriculum of the Tuscon Early Education Model (TEE;M) emphasizes 
four general areal^ of development} Itinguage competence", an intellectual base 
(basic learning skills of attending, recalling,'evalu4tln^ alternatives); a motiva- 
tional base (task persistence, expectation of success),-' and societal skills (reading, 
writing, math, ;and soolarskflls). The dlassroom $ti*uQture In the TEEM program 
consists of small group activities, organized around a variety of interest centers 
and behavioral settings where interaction on a one-to-one basis Is provided with . . 
frequent opportunities for attending to the Individual iieeds of eabh child. Support 
of each child's contribution, attention, and affection areus.ed as social relnfor§ers 
;>an d learnin g: mater ia[s^ are chosen 'for their rieinforoing value i 

Bank Street College of Education (BC) • ' \ " 

V The Bank Street model aims at developihg active participation In each 
child and self-directedness.in his learning, Teachlnjg is diagnostic, with individ- 
ualized follow-up In a classroom ei^vlronment allowing for a, great Variety 6f ex- 
periences and Independent Investigation. Language,, math, arts/ and crafts are 
Incorporated and integrated^into a.curriculum whioh' emphasizes the home, school,' 
and community. The lear.rling envlronnjent is constantly restructured to adapt it . 
to the individual needs and'interests of the children. The Mnk Sb^eet model 
focuses 00 tasks that satisfy each child^$ individual goals and promote his cognl- ' 
4iv«.and affective development; • - ^ , 

■ . ; ' . ■ •-: . ' 

\ Uriiyersity of Oregon (UO) * ^ ' . 

\ The £nglemann-Becker m'odeT |s a highly structured, academic program 
based on the premise that, with proper instruqtlon and consistent reinforcement, 
any child can acquire the fkllls necessary to bring Kim yip to the achievement level 
of his «Biddle-class peers. Using programmed materials, adults In the classrdom 
work olpsely with small groups of childi'en in a format of question-group r-esppse 
feedback to teach concepts and skills in reading, arithmetic, and language. > 

^ The University of Kansas (UK)' ^ 

.:W "~~~~r~~^~~ ~~~~ ''^ ' 

. The University of Kansa J behavior anaij sis approaoh aims at teaching 
children geeded skills by me^ns oTsysteinatlc relnforcei^^ 
emphasizes individualized in^trucnbn thrpuglv the use of programmed, ttiaterlals . 
Teachets-and trained parents operate in; the classroom' as behajvior modifiers. 

High/Scope (li/S) ... V ■ . • ' : 

- t_ ____ . ■ ■ \^ ^ ^ • ■• 

The High/Scope Head Start model ik a cognltiveiy orientecl preschool 
program derived from the theories bf Plaget. Thb bhild's level. of performance 
is determined and materials are then presentepl In sequential fashion, from the ^ 



simple to the complex, frbm ^he concrete to the al)stract. Develop nient^of 
language and qf A good s6lfeconcepv are important prc^ram goils • fXearillng 
objectives are stated as behavioral goals, that describe the expfecterf tfehayior 
resulting from a learning activity . ^ : ; * ? . 

" The University of Florida (UF) \ s \; \ "^'^l 

' The UniVersI^ of Florida model Is not a classroom mSdel; that is» it \ 
prescribes neither curriculunv nor teaching methodo^ Th6 pilmary focus is / 
pa^ei^t education. Parent-educators ari9 trained by the teacher to work in" the ^ 
cl^ss^Goms and they also fenter homes to educate other parents to participate ' 
directly in the educatiori of tKelr children^ Learning tasks artf devMoped that', 
are ^xpected to allowjiome and school to \vork as instructio/|al partners. ; i 

Education Development Center (EIX !) 

The EDO Head Start modeMs derived from the British Infant School 
appr'oach to preschool education. It provides a learning environment in which ; 
class activities arise from the heeds and interests of the children, hot from a 
prescribed curriculum. Th^ teacher serves a§^ / 
children and structuring the learning environment* 

■ ' -■• '„ * • . ■. - - , . ■ - • ' ^ / • • . • ' 

The University of Pittsburgh (UP) / v l 

j The University of Pittsburgh model is an individualized feducation pro-. = I 
^ram. The most Important component is an Individual progress plan in which ^ i 
6ad^^^hild works through the finely graded Steps of tl^e currlculuhi acp^ording i 
to p's ow^ learning style and i?ate. The curVlculuiti aims.at teaching skills and j 
. CO jiceJiits basic to^\ahy subject areas, such as basic perceptual mptot* ojrlenta^ | 
tlqn, language concepts and logical processes, memoryv ancT^i^roblem-solving ^ : 
sl<ills. Learning objectives are arranged in a sequence according to the order 
in' which children leajfn these skills and concepts. For e^ch Objective In this 
sequence, th^re is a brief diagnostic test forjuse by the teacher Ip assessing a 
child's progress so as to design an Individualized instructional program. 

■ , -. - ^' . •■ ■■■ ■ . ^♦ ... ■ r. y ■ , . . , , , ■ ■ 

Respbns lye Environment Corporation (fiEO) • . ' 

The R EC program utlHzeiS. specially, designed materials and educational 
echrtciogyjaa cu'irriGulUm which emphas^2es individualized, independent work* 
bsprvation ofTK(r^hlld-gul<te^aihaJt$a^ ^^(J organization of ^ 

later ials and activities- >The environment Is caplefullj^baiariic^ structured 
'and nofi-;structured activities . Language development, understanding and Incorporr 
jating basic concepts, and enhancernqnt of abstract reasoning ability are empha- 
/'sized in the curriculum 



r 



New York University (NYU) 



* . The NYU curriculum focuses on both the coghitive^and affective growth 
of children.^ The prograiji emphasizes' concept fprmation, perception, lan^age, 
seifr- image aad sbcial-^emotional growth. Small group Instruction, ongoing 
teacher assessment', and classroom management techniques are utilized to 'effect 
ittdividualized instruction. v v ^ • / - 



The Enablers (ED) 



In the beginning, CCD assigned an early childhood education specialist 
as a consultant to each community partlolp^ltlng in Planned Variations. These . 
constjltants worked cl6sely with local llS staff to expedite successful integration 
of the sponsored model^ lnt6 the ongoing IJS ^rbgram; this was to ensure the 
"integrity" bt the regular HS program. 1970-71, the role of thes^ expert 
• consultants was developed into a model In its own right. The Enabliar modeler '9 
•role was to provide ongoing technical assistance to edch staff and HS community 
so as to help them formulate and achieve their goals. 



Assumptions Underlying. Planned Variation 



7 



Of critical iniporta^cd t<^ an understanding pf the PV study rationgile and 
approach Is a knowledge of th^iiportant assumptions Inherent in the original 
conception of the experiment", ^hese assumptions have been clarified through 
several studies conducted at the Hurori Institute ,3'^' 36 The PV design was based 
* on, the assumption that the models ai-e well-defined th terms of operatloi^al re- . 
• qulrements for classroom behavior and that the model is, Indeed, th^m'ost 
importaht determinant of behavior in the classroom. 

It was also assumed that the\)nL^ 
f and that,; as a resulty classroonv io^ac^^ in all 

of a specific model's class'rooms in tht^ various sites; Pull implementation, then, 
. might be defined as sito-to-site r^pllcability of a model in all of a sponsor's sites, 
Further, it was expected that the sUff in a center would readily adapt to, and 
properly interpret, the sponsor's model. Full Imt^lementatton was expected to 
occur in all mpdels during the ;ast jtwo years of the experiment/ The possibility 
that there may be Incomplete implementation of some models, or even a*failure 
to implement models^ was apparently neyer really considered by U\e planners of 
the study, * ■ \ 

' ' ^ " ^ ''^ ' ' r ' ' ^ ' ' ■ / 

These early assumptions^ now appear to be somewhat naive, there is much 
A^v" evidence to contradict the asslimptloh that. the mddejsi^ or treatments, were well 
defined or that teachers r)ecesj9arjily instructed irt'acc^rj^nce with the sponsor's 
directions, vExper|e;)ce(ll teach^ra were sometimes required to radically change 
' long standhig classroom practices so as to comply with sponisor expectations* 
It is ftlso questionable whether the model iff inde0d the primary Input into the • 
ckssrc^i behavior ^ Finally," the replication of sponsor's models from site to 
^ site is longer assumed, or even expected in some cases/ since some adapta- ^ 
tion Is rffeceslsary To fita]mhB"sy5tB^ 

tion i^ being Investigated, as well as the outcome- effects of the spons6p's models. 
SRI Classroom cObservatton Study . . . \ ' 

1972^73 J SRI wa^ requested to attempt a more detailed ^nalysrts 
of PV sponsor impiementatJon as measured by the SRI Classroom Observation 
InstrumCT^ti \ • ' , 




The questions raised wer^B: ^ ; 

(1) Do the model classrooms realjy differ from one another anH from nori*: 
isponjored Head Start olassrodms ? Are there really 12 different ? 
models? > '/:■'■ ^ - ^ ^ • i . ■ ' \ 

(2) Many peoplo olalm that the reas^^n Head Start programs never showed , 
striking effects on children's test\perfoifmances wAs that.th^s'e prbgrams 
W0re.never Implemented: Can thlis be the explanation '5f the modest 

• . effects? ■ . ■ ■ • ^ ■ 



The three molt trou^lesojiie concepts. M these questions are "differences," 
" "Implementation, " eyid "striking effects . " approach the quesilons posed 
abov^, It is necessary to define the concepts on which they ard based. For thei 
first question', one mu^t discover which differences are 6f interest. Certainly 
sponsors differ in tho statements of intent displaye^l on the preceding pages, 
There may not be 12 entirely different child development theories on whl6h thie 
models wer6 liased, but.no two sponsors extract th^ same metliQlologlcal Im- 
plications from the theories even when,th6y hold some theorles In common, as 
do the University of Oregon and the University of Kansas, or as do Far West, 
Bank Street and EDC. • • 

The sponsors also are known to differ in actual methods of implementing 
programs at the sites t It Is known from _inforn>al c0ntact^ that Some. sponsors 
refrain from Imposing a particular teacher-pupil interaction style on anyone; 
whereas others r igidly pr escribe '^nd monitor tochers" interaction styles'. 
Nevertheless ^ all j^ponsorg In.tKfe gyoup. would/appear fo be, and might be de- 
clared, "alike" if inyestigatlorg r6vealed^at aU . V , , 

. (1) ' Sponsor represftntatlYd;orl8cal pi/offibam coordinator on site / 

(2) Training sessions for the on-site pt'ogy^m o 

. . 'I'-. " ■ \ ' ■/..-'' ' » . 

(3) Training sessions for teachers. 
• '-^j, \ ■ . ' 

ObvliJusly, to be different in the present j^tii^ means to differ In tj&rms of those 
classroom process variables defined on'/the SRI classroom ob8ervat^i6n Instrument. 

The defining conditions fpt prograjiii "implementaUon"i.9re also Stated ^ * 
tirely in terms of the SRI classroom observation pr<ycedares..*/Whlle\tHe , 
-Gategotieflr of4)ehavler- to-be re<W)r^3©dHD(n4he Gla^ssroom Obs^rvatldirlristru^ 
(C 01) were created, with the help of m6st spons*orS| to capture impdirtint ele- 
ment In their progifams, it cannot be/claimed ftiat all the models ^re described 
definitively by the COl!r-B» ®ct, It.li clear tliSt s6me models ;are better\s'erved # 
than.oth.er: in this respect. Sponsors -who can descrlije their JbtendedsOlassro^ 



♦Implementation could be defined without requlrlrigilKe' sponsor's give ftn 
explicit statement of their lritentlon| and without measuring the altalntncnt of 
these Intentions by observation devices based on their statements. "Well 
lmplemented"^nd "poorly Implemented" could be left to the sponsor 's 
judgment jfmd rating scales could be used by "the sponsoif to measure It. \ 



\ 



programs In terms of observable behaviors which are i'elatively .easy to translate 
into operationally defined categories can expect to show better "degree of imple- 
mentation*' on the COI than sponsors who use more global pr theory-oi\ienfed 
descriptions of classroom programs that are difficult to observe reliably . 

The.relationbhlp between showing differences am^ng siionsors on the COI 
and showing "degl-ee pf implementation" of each sponsor Is also .quite coi\ipUcatea. 
If one observes reliabfe differences among sponsors on the'COj/one might say 
also that the planned variations exist} i.e. , variations have bpen implemented. 
9n the other h^nd, when two sponsors differ from one another on several COI 
variables (on \vhlch w^ would have expected Uiem to be the same), it ma/'mean 
that neither model is well implemented in. terms" of its own 'aims or oiie Is better. • 
Implemented on some variables and the other is better implemented on others, 
or that one of the sponsors is poorly implemented. Several definitions of 
"implementation" are explored in the rejJbrt. In addition, an attempt is*:^i>ade 
to get at.a less relat;vistlO' definition of "well fiiiplemented" than is obtained * 
when one sponsor is compared with another . ' This attempt is based on the 
diff^|il)pes on COI variables between the sponsored models and the non- ^ ' 
sponsor'ed Head Stfirt classrooms. - ' 
■ . ■ ■ ■ ■ ' '■ . ''^ 

. ' , Finally; whether the effects found*in past evaluations of Head Start are 
"striking" or lesS than expected is a matter of judgment. It is possible that in / 
the pt>esent sturdy, where the comparison group is not children without a pre- 
school program but children with another, albeit un-sponsored, child development 
program; even.differential. effects on test performance that were barely' detectable 
by eurrent statistical means would be "striking" when contrasted with other 
recent findings: If differential effects aye found,' it would be' extremely difficult 
to attribute. rfome effects to diffeij'enc.es in level of Implemeritatlop and some 
effects to differences in the nature of the models. And if there are no di/ferential 
effects, such attributions would be impossible. It is possible, however, to in- 
quire whether those dassrooms, where models, were well- implemented (according 
to one definition) are the same classrooms where children's test performances 
were high, this method is employed in the presetit stu^y. 

■ ■' • • ■ ■ • • - > J 
The results will be examined, in sequence in terms of the following three 
questions; ^ . • v . ' . ' 

' • Were there diWltiict'^ . / 



In what way (160*8 degree of implementation relate to outcome 
measures? 



TJje first; question deals vylth Sponsor differentiation. Each sponsor^s program 
will be described In termsW the CO variables that designate the classroom pror- 
cesses and behaviors judged to be^most reilvant to his specific curriculum. Thus, 
a list of selected implementation variables Is geherated for each sponsor. These 
variable sets are first examWd to see how mahy distinct models are revealed on 
the basis, of stated classrooni, objectives .translated irtto CO vatiables . Observed 
differences among sponsors oti all CO variables and factors ate also examined. 



- The second, question Is concerned Vith the d^gx^ee of implementation of these 
treatments. First, observed mean freqyenpios on selected implenyentatlon vari- 
ables are (^ompilred with sponsor expectation^ on thege variables to measure • ^ 
consistency betsv%en stated Intentions and classroom events. A Sj^cond indicator - 
of^irnplementatiou, site-to-site consistency on selected implemejitation variables, 
is also examined. Fall-to-sprlng consistency , although not in Itself a;n Indicator ^ 
of the level of' implementation, is a corollary qu6Stiop which is/also dealt witlu ^ 
Ift. cases of chungo, It is possible to assess whether -U\e fall oiVthe spring frequen- 
cies on selected implementation variables are more consistent wlth' the spbnsor's 
intentions. , " / . 

The third question deals with the is^ue of level of implementation as It re- 
lated to/outcome.v \Vell implemented and l6ss well Implen/ented 
be identified for each model, Jb^sed dri the impli&mentatioy{ variables identified 
as relevant to each sponsoi^'s'^Srogram. The children's test scores. for k sponsor's 
well Implemented and less welj lipjjjemented classroonis will be conipared to exa- 
mine sfr^ther a higher, degree of implementation is associated with higher, test 
outcome^ . If these classrooms .ciiffer in terms of tesjt score^ , fur ther examination 
will be imdertaken to determii\e whether it is the model's implemenUitlon variables 
which are related to higher scores. ' The relation of/ implementation to outcome is 
also/explored through a series of regression analyses linking classroom processes 
to child test performance. , / 



In 



MET^IOD 



. This chapter Is composed of two major sections . The first section is^Ji : 
brief description of the data collection (ittore.detail^d desoriptlohs of the instruj^ 
ments and procedures are included as ap jendlces) ; 4 The second section des- ^ 
cribes the analysis technlcjues by.Avhloh thp.critiQal' variables and frequency data 
were generated, the sponsor differences were examined, the degfee of model 



implementation was asjSessed, ancTimple^i 
Data Collection 



iientatiQji to outcome was^eyaluaterf. ' 



pis part of a multlf^ceited evaluatloh. 



. The SRI Ciassroom Observaiion'stucW v.. « ...uxvt»«v,^cu cvaiu«*viuu. 

As a major facet of the PV evaluation, panicipatin^ Head Start^hildren were 
given a battfery of tests ill the early fall arfd late.spring bf 1970-71. In a siibset 
of thp tested classfopnis, classroom proclspes'wefe observed twice during 



that academic year, once in the fal^.and or 



.cein the spring. 



The SRI Classroom Observation Instrilment (QOI) is composed of two major 
sections: the Observation Summary Form (OSF) '^nd the Classroom Observation 
Procedure (C9P)J The OSF j^oyldes'a dally rec6rd)^f Identificatloii Informa- ' 
tlon. Class QbserA^ation Information, Summary of ciassroom Environmenti > 
Physical /^r^angefnent and Equipment Avai ablel The Classroom' Observation 
Procedure (CpP)|consists of (1) the ClassriooWcheok List (CpL), (2) the Pre- 
♦ambl^ to thie Five- Minute Observation, ahd (SYthe^Five-Minute Observation . 
(FMO). One CC>P .is completed, .^bbut eveii'j^ 16, nilnutes throughout the' Head 
Start classroon;! day. . The CCL is used to {efcord groiipingfs of ^'duUs and chil- 
dren in activities.. The P'reamble provides jlhformatibn ^l^ut liife specific . . 
activity that is the focus^gf the following FMO, on y/hioh i^ Recorded the iMer- 
actlons among children and adults, in the clisst-oom. Appendix A describes 
the Classroom Observation Instrunient on AtfhicH th6„d^ta were recorded, the 
procedures used by observers who record^^ld the data, .and the sample of class- 
rooms, teachers, and children on which the data were collected/ This appendix • 
also presents changes in procediJU?^rfi'm the f^ll observation period to the spring 
observation period. Operational idefihitionii'of COI code categories are given 
in Appendix B,; ' 

Appendbc.t) describes the outcome mefsures^ists) 'that Wre given to the 
children. Prpd edures for adrnj^il's^terin^^ in an eaplier 

report. 3/ Thi^ report desqflbes;^only thW'^nteiU of the te^^^ scoring ~ 

procedi^res s.o.tjiat the reader wlirfeis able^o determine th4 ways in v^hich spon- 
sors' elds sroon>prdcesses might be expected to relatett^chil^en's performance 
on these tests . 1 • ■ 1. . . . ■ 

'■ Analysls-TechniQues ./ , . ' ,i 

This sectioh describes those procedures (computer' and statistical) wheireby 
the coded information cpntained in the c^nipleted COI protocbjs was' converted 
to frequency data on variables of Interest; In the aiudy/ then it describes how 
the data were/analyzed to insWer the qujbstions i|ate^ in Chapter I. ^;^ause / 



^ the study. was not designed as an experiment With ranclom ^sslj^nment of subj^dtg 
^"^'^ to troatments, Ihe data collected in PV classrooms do not strictly; satisfy We- 
retjulremetits and assunVptioris of the statistics teohiilqu^s employedj ho^yever, 
.the dafa/are no mdre Adequately assessed by techniquels appropriate to 6th6r ^ 
- assumi^tiops* 'iWs^tlstics chosen possess the power and robustness ne'cessary^ 
to ovWcome deficTenoIies regarding normality and homogenei'ty 6f .variance. 38 » 39 

- #: Generation of Variablei an^d Frequency Data y ; / 

' Ij^^:^! Stair t Tape Creation * V / 

As data came In from the iield, the observation protocols were sent 
(Urgctly to National Computer .gyotems. (NGS) inMinheapolis for optical scanning. 
There the forms were/'read'^ and the -information wi^f^transferred to magnetic 
tape in binary cod6 according to SItrs tape specif Icaffdn, Th^-tape bontalned 
80-colunv| card Images of the observer inarks on the protocols and ^)Oas thus a 
packed andunsorte'd direct copy 9 f the forms/ When the tape arrived at SRI, 
/ it was listed and hand-checked against A five percent random sample of the 
forms. When quality was assured, a program was written to create a new tape 
that grouped ail observation data by ola^JS^ site, and sponsor.'. Non- ' 
sponsored (NPV) comparison Classrooms were grouped separately from sponsored 
classrooms for each site» / ^ 

- Defining Variables • ' , , . • ^ 

' ;As was mentioned e^^pli^r, the categorl6^ pn the Classroom Observation 
> instrument were cje^lkned to elements of 

event^ coiisideriBd ddu^^dtionaily s by one or more of the sponsors. 

But eVery category/ and all possible combinations of categories simply could not 
bb dohsidered as V vriam^^ number of appearances of each 

category pn the raw ^a^ tape iM^tfs^^^^ as a quantitative measure. Only the 
• categories or conim that were of pbtentid relevance to the 

; models wergjttsed to define yariabl^^^ in the evaluation of PV; then a frequency-. 
of*6ccurren^<ir^ of 69 prbc'ess variables 

was created; of)eratipr)al definitions brthese COI vari^^^ in Appendix C^ 

: / Obserya.tion SuMmary jFprm Variables - tOnl^^ Sum-^ 
; mary Form (OSF) categories used. These were combined in a single ■ 
variable desprlbing one a^peot/of classrop environment. / 



aldes-ph-the-fif st^ay^^ is divided by the member 

of children present, W>e^ r^lo. ITielsame ls^^ - 

second day / The m^n/br t ratios ^^^^^ befeofnes the average adtult/child^ 

ratio per day, v-^'pr e^^^ have a Value of 0.2 on that 

Varjable if one tea^bfer a^d-^^e werfe utere both days and ten chil(]yj.6n ^were 

j{)resent both^^^^^^ J ' 

* I /'Gla^sr^^ 

gories orft^ crafts) were taken 

falyly^dir'^fctly (e;g. / Variable l4--*arts» crafts); That 

is, ifjthe^'arts/ cr^fts^lsaU^ on tip protocol, th'e value that 



/ 



V • , /: / 



the varialjle^ftok for that COP was It 1( the arts and orafts activlW^ was not . 
;,mairked, th6 value'the variable tissumedwas zero, Each activity .\^as either * 
Observed during the CCL recording on the COP or It was hot. •Thu$, the unit 
for C CI; variables, w^is the, GOP and the variable frequency was the number of 
times the act'tvity occurred divided Ijy tj\e numb'6i*-of COPs recorddd. / . * 

■ A few variable? were fprpied by comb;blTfi/ activity caVegcJfies, sUoh as 
Variable 21, ''Wide variety, bf activities," 'The values {I or 0) ofjacfi bttheN. 
activity variables (Varlables.O to 16) were sumvned. tlius'''WWl^irl^ty o( ' 
activities" could take on a value -from. bije, (If only ojje ^etlvity category -was 
coded) to eight (If all activity categories ha<i't^(s^e^(5Q^dj. Th6 COP was still 
the unit i /is it was for all CCL Var fabled. ' ' " • ; /f : . ' 

^ Five^Mlnute Observation Varlablfes -'-tfdcause it reeorda intfirantinns . 
as they occur, ,the F^lO'pcrtloh pf^the-'Qlasst^ooni Observation Ihsirunient has 
a rather special naturev Tj>e^data' collected .cn the FMO are structured as a 
language, slnQ^ they are code.d In.the form ef srewtences saying -"Who did what 
action to whbrii and how it \yas done. " Hie. iangiiage 6f ih^ oat^orie^ has a 
predefined syntax. That is, there are certaln. coded' sentences that are accept- 
able and Others that arfe nortsehslcal. Th^ language is related to English, but 
in the CO language there are mShy English sentences that are equivalent even 
though they have different meanings. For ejjample, the two English sentences 
below make equivalent coded sentences on the FMOr 

English Sentence -'COSentenee 
. / WHO TO WHOM WHAT HOW 

Classroom aide tells John that his ° ■ • 

finger pointing Is beautiful. * A C. .6 

Another sfide tells Jolinny/s friend : 

that he is a good boy. - . A . C , e \ - 

FMO Interaction variables are defined in the sentence format. For 
example, If vve are interested, as in the University of Oregon mo^iel, in deter- 
mining whether-using aides to Instruct children in small groups has kay different 
effects from using the teacher to instruct cmldreri, two separate vki^ables are 
created: "Aide instructing a small group" (AS4-) and^'Teacher Instructing 
^ntalt-^rW— (TSM^— Lf-v rnjire only interested in vyhetber an adCdt/frather thah 
specifically a teacher pr aide) iis instructihg a small group, then the variable ^ 
would be defined as ''Adult instructing $mall group," e»g. , / 



.. If it is of Qpho^frn how the adult instructed tfie children » then the deflnitlbrt would^^ ' 
not be nonspecific* In the last position but would^peclfy a ''HoW" code, e.'^T(fM 



WHO 

T' 

.'A 
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TO WHOM 



WHAT 



'■ \ 



HOW 


■ : - * ' ■■■■■■ 
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For somt) models J rteithfer the category tiQV the single sentence captures 




WHO \ 


TO wh6m * 


WHAT 


. HOW ' 
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Because not all COPs had an ^ij[ual Jrarhe CQunt, FMO frequencies ^ 
could not be calculated by dividing the total bCcurrerice of FMO jvar^lables by tbe ; 
number ot COPs completed* Instead > cUssroom frequencies of FMO^varlaSU? ^ ^ 
were calculated by dividing the number of times the variable occurred by the - 
number o| frames recorded on each OOP <ipm)^l^ted for that.cla^sroom^ S6 ^s 
to make the FMO variable frequencies ^proximately coi^^ to CGL vaW- ^ 
able frequencies, the FMO frequency was multiplied b]|^ tiie^^rtaKlmum humber^f--. 
frames per COP (i^ev, 60); thuS j if the value of Variable '44^ Adult adlgic^^ 
ledge Aent to c hild response, is t! hre'eV this meap^ that! oh tiie av erage;riu^ 
int ■ ' ■ ■ 



acknow^dgement Qccuips three tjiaes per: GOP (or 



The FMO portion of the COP consists of 60 frAmos and should take the obser- 
: ver aijproximately five minutes to complete; however i at times ah observer 
codeb at a slower rate and fev?er than 60 frames are completed withj|i the 
five minutes I k . ^ 



Once tho variables were clef inod, it was possible to create the principal 
daUi tape for use In the 'analysis. From the raw data tape, a new tape was gen- 
erated which computed, for^each classroom, the mean frequency of occurrence, 
and Standard deviation of each variable. . The principal analysis tape thus con- 
tained a frequency distribution on all 69 variaWes for each classroom, by site 
andoponsor, identified as either PV or NJP.V. 



■ The Units of Analysis ^ 



Although the sponsors were accepted by, and htKl a contract with', the 
entire Head Start protect at a slte,^ thfelr ^agic "instrument" for model impler 
mentation wasrthe claks'roottXjea,ch6r . Similarly , although this analysis is 
concerned with sponsoV implementa'tioh within sites and over 'sltes"wlthin'spon' 
.sors, the basic unit of analysis is the classrqoni. . Thus, while cl^srooms per 
se ar<3 not compared With' one another, the frequency ' value of a given variable 
Is first determined for each cljfssroom in the' sample, in the mShner described 
above. When mean vai'iable frequencies are presented by site w by sponsor ' ' 
it is always the^meanof the frequencies of that variable in each classroom in' J 
the site or under^the sponsor's' jurisdictlort. The standai-d deviation is always « 
ah expression of the variance bet\^?een the means of the classrooms so groliped. 

Selected Sets of Variables - rthe original G9 variables constitute a 
fairly exhaustive list.- Included are many variables wl)ich most sponsors and 
other educational theorists agree should be positively r^late^ to children's 
performance on academic tests (e.g.* Variable 40, "Adult infofming child;" 
Variable 56,w."An adult corrective feedback to child"); howeveri there are some 
variables which should distinguish one sponsor's model fronvanother!s (e.g; , 
Variable 46, "Adult direct request, tolloWed by 'child response, followed by 
adult corrective feedba:ck; Variable 80, "CHim'lnVer^ct.s with machine"), and ' 
from non-sponsored Heaa^rt programs (e;g. , YaViable 6, "Adult/child 
ratio," Variable 19, ' "Teacfer \vitIvlarg(B group in afty ac In this full 

set of varlftblfes some are p^ticularly relevant for answering the main question 
posed in the report: Were t^ models VV611 Implemented? V ,' 

f he tmplegientatlon Variables "-Based on the sponsor.^' stated theories, 
classroom methodologies and behavioral goal$, and the SIJI staff 's acquaintance 
with modets, a list of variables was selected which Would mdst clearly reveal • 
degreeSpf implementalion. Tor each of 11 sponi^ors , several variable^ jv^re 
selec^edjrom the fuU list vvhich woufd be expected to oQcur frequently or 
IhTfequer^tlyirftt?^^^ a list wSs not created for the 

Enab^g mpdeL since no description of .desired classroom processes wak 
available* Although the Florida model is not a classroom model and. directs 
Its energies toward the home, a list of CO variables \yas nevertheless con- 
structed oh the .basis of our staff^s previous knowledge of desired classroom 
processes in that model** ' ' 

*While the sponsor does not directly, train teachers to implemeht certain class- ' 
room prdcesgg^i he does share^ sonve educationar philosophy and expresses * 
prfefer-ehces for the way teachers work with children . In additidnt the parent 
educators with who^tti he works particlpajte.in Head Start Cehtei^ activities and. 
share these theories. • . • . . * 



BUR 

iS-BS 



In the set of 28 Implementation varlaljles there are approximately ten j 

• variables for each sponsor i Each sponsor's list of variables Includes those 
process varla|)les judged by SHI staff to be^^d^t 'descriptive of 'the model's . 
rfe^ired classroom processes and' thus potentially most capable of^ Indict 

the level of implementation in his classrooms. Not every variable is relevant 
to every sponsforr Table 2 displays. these SRl-seleoted imptementatlQn variables 
by^sp^Jnsoy. Variables xleslgnated *^hlgh^^ are ones on which a sponsor's w^U 
jmplemiented classrooms are expected to attain high frequencies; ones.miarked* 
'*low»^ are predicted to occur^lairequently in well implemen^ted classrooms. ' - 

^ SeverVQlobal Variables (Fa6t6rs) --^lt is admittedly difflpult to con- 

• cepiualize all of the shades of difference Ii^ classroon\ behavior among spbnsors 
and sites in terms of the 69 individual variables. Factor analysis permits an 
econpmlcal groaping of variables into a smaller , more manipulable set of 
global variables without loss of an* excessive amount of variance accountability* 
Factor analysis also offers a further ^v^ntage in that normalized factor scores 
can bo obtalned and gi*aphlcally displayed for any grouping over which varl^blp 
frequency ban be recorded. . / ^ 

Initially, each of the 69 variables was incldded.ln the factor analysis. 
^ They we)?e arranged in a correlation matrix and subjected to a principal coQipo- 
nents analysis.' Varimax rotations were performed to/yleld a set of five facto^s^ 
Upon exai^ination of the analysis, it was determined ^at ten of the variables 
had ifew ^pmmunali ties and loadings on the factors, aind that the total accountable ' 
•variance \VasJeas than 60 percent, The ten variables were (dropped from the 



matrix and th OT^emainlng 59 were ag ain subject ed to a principal components 

analysfS* Varllfnaix rotations were peHorTSMlyylerf sets of five, six, seven, 
• eight, and nlnei^actors?* Of these, the^ even- factor rotation represented the 

^\ ^ best.balance be.^eeh factor fnterpretablUty and variance accountability. It 

accounted for GiCrpercent of the matrix, variance and provided factors that were 
more Inter'pretable tha'n those fi*^om the oth^ potations.^ Table 3 names and* : 
describes the seven factors and shows the loading of eaoli variable » * 



A 



Factor Sc&r4^ 



; Factor scores for each classyoom* (classroom is always the unit of 

> analysis) were conjputed* to be able to use the factors to describe sites • ^ 

sponsors; A faotor score is the weiglited combination of scores on all ^9 
variables for a given classroom; The weights' are'determlned by'^th^^^ _ 
loadings. Theiactor scores In this report have the properties of be^^ 
dlstrlbutedr wlth a mean of zero a^^ ^ 
'^r- vverei computed foi^U sponsors, >rvUJsvnot Included In the factor analysis 
^ because o.bservatloh site was not plJsexived in the spring; Appendix G ' \ 

, contains dassroom m^ ^ ; 

' all PV, all NPV and by sites within sponsor for Ml and spring observations* 



,^*By ^the.least-stiuares/solution described by Paul Horst."*" 
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.\cllvity !l (group time, iharlng. reit. 

Wide Variety of actlvltl0i . > , 

tndeperKlcnt chltdinctlvlly ' 
A<K*tt «ith oh<? or chtldreft 
Adult lofor mi rig child u»lnn conerete 
obleet* > 

AdiOt .cholce rMU<»«t to ehi!d 
Adult pralie td'tMUf 

Arfutt acknowlfdgemehtjto child- 
Child *elMnitrucllott u«Jng concrete ' - 
objects 

All child iclNinstractiofl v 
Child inlUulei InteroctJon ulth adult 
Child tnltlatea InleraetionVuh othtr chM 
'Alt motion 

Unh crjiiiy of rior/d;t 
Adult/child ratio 
lniicpe»>deM cMld activity - ' 
Adult Mith one or i^o c^itdren ' 
AOult Info/fulnij ehJd usltiit concrete' 
object* * 

Child «elMn*tiHictlon u;5{nj( concrete ' 
cb)ect« " ■ . '? 

Adult Interaction \*lth orw or tv^o children 
Adult inlcructJon with jnuH group 

LtQjverilty of Arizona . 

Activity- n (group time, ^h.tSirtKi 'f«^- 

itory, linking. dapclngV 

Wide variety of act(vit(cs ■ 
lr>depcntlent child uctlvlty * 
.Adult Infornilnn chlU u«lnjj' concrete 
objects ■ 

Adult choice reque*t to child 
AduU pralie to Child 
. Adult ac.l{/>fiMcdj{cmciil ia.chitd^l^^-^ 
Child selMn»tructlon usinu concre'ir 

* object! » ^ ^ 

. All child •elMn«i|nctlon , ; J . ^ 
Adult tenter acttoft Vfr.llh orw oe Iwo children 
Adult lfl(erdc(loft v^lih *niall group 
Child Inltlutea InterVctlon ultl^ othef cKttd 
Child cooper alen with other children 

, . All motion. \ \ 

Educational J>eveIoj>menr Center 

. ActjvUy p (numbcr"i<*^fi>habt I. rejdiiv, 
Uh^uajte developmemu / 
. Wide variety of tt'clUitie* ' 
I Qdep^ndenf child -activity ; 
Adult With ort* or l\\o children 
» Adult Infcirmlrtif ehIM unln^ cortcrete 
"objecti » V - 

Adult choice requc«4l lo child 
Child «elf-Jn5truclIon using «)»mtjo|lc 
objeclj • . ' 
* Cfhild *elMi\5ltuctIott Ujlnu ^ncrclr 

Child inhialQS Interjctloti with ttduU 
. ChKd Inlttutet InteructionXih other 
child 

. Child cooperate* with other children 
. All motion *. 

^^, flank St rwt College of Education * 

Wide variety of activities . 
Indep^tvdent child acllvily 
Adult with one or two ehlld^^ji 
Adull Informing child unlng concret* 
obiecia 

AdutI chofc« request to chUd 

Child seUfln^trMclIon u»ing concrete 

object* 

Adult lnter«ctIoft>lth one or two children 
Adult 4nterftc(ton with * mall group 
thlld InltlMcji Intcraciioi} w.iih oOic^ child 
Child cooperate* with other ftWldrcft 
AU motion ' ■ * ' . 



' ■ ■ ^TaWea ^ ; 

$KlKCTtDlMl^UMENTAT10>; VAimul.V:S DYSPON'^t^H 

Expevied • . , 

>>ecmenoy V'arbbU ' / 

/ Unlviraity of PIttf burgh (cDftiinued) 



Kxp<;^ted 



t University of pittabur^ 

Activity C (numbers^ alphabet, heading. 
Unguage developrmeM^ 



• high 
high • 
high 
high . . 

high 
high' 
low 

hlfth- ^, 

high 
high • 
high 1 
high , 
, high 



high 
. ^hlgh 
hlgh^ 



high 

high 
high 
hl^h 



high 
high 
high 

high 
high 
tow 

-hlglL- 



high 
hl^h 
.high 
high' 
ttgh 
high 
high 



low 
high 
hJgh 
hiKh 

high 
. hlRh 

\ low 

high' 

high 

high 
high 
Mgfi 



high 
high 
high 

high 
high 

high 
high 
high 
high 
high 
hlRh 



high 



6.1.^ 
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. My 
4f. 

i4. 
03. 

ro. 

21. 

- .15. 
» 46. 

44, 



3?. 

on. 



1.1. 

21. 
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u2. 

^4, 
02. 



23, 
' j2. 

3a. 

54. 
63. 

ro. 

■72. 



25, 

49. 
o3. 
:)7. 
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AduU v< ah ^tHj or two children! n academic . 

actlvljilea (C and In ' hlith ' 

Adult with one ot two children high 

Adult inforn^ing child using *ymbolfo object* ^ high > 

Adqii Interaction with one or two childr'en high; 

Adult Interaction with f mall grojp ll>w - 

Child Initiates I ntefrtcllon with ad^lt high ' 

, University of Oregon j':'^^"^ ' 
ActMly 0 {m«mbe|/i, alptjftbt^t/ rtracj^^g. 

langifugo developmV^l) , high' 
Adult wlt^ small group in acadehiie 

Activities ' ^ - • high- 

Adi^tt Itiformlng chlfd using symbolic objects high 

Adult direct reijoepl followed bj child ' 

fes^x)n8e foUoiAedby aduU^rrcctlve feedback high" - 

Adult dire'ct request followed bv chUd • - ^ 

' res^tonfce followed by adult ife<inowledgement high 
Adult direct request f^llowiJd h>Ahl|d 

response. fo{lott<;d by acquit 'pra I j^e high 

Adutl prats* to child, high =^ 
Adult ack now ledgfmetiUo child 
Adult |)os{! J ve correct I ve feedbiick to cMld hfgh^ 

Adult interaction with agnail group • ,r hlgh^*^ 

Child inttUtea Interactlftn with other c*rt Id' ' . low " 

' Hesif'^nslv^ rnvlronment Cor^wratiop 

Adult with small group In qeademlc 

activities * . high 

lndep4»o^nt child activity -high 

AdulUnformlng child using symbolic objects high 

AdufnVformlng ch«d using concrete objects high ^ 
Adult <llroct ffquest followed by child 

resj)on,«e folloued by ^idulf correcHv e fee.Iback high 
Adull direcl rtquesl followed by child 
response followed by adull ackDowledKcment ' high 
;.Vlult direct request followed by child 
^Tfffpsnso folloTOtt^irdult'iSTiti?- 



high 
high 
high 



high 

high 

high 
high 

high 

W«h 

high 

high 
Mgh 
high 



Child self'lnstructMtt using lyttibollc objects 
Child selMnsffUctfon Usln^ cOhcrete objects . 
' Adult interact Ion with smaU group 

l^nlv^rsltyof Kanws 
Adull ■'child ratio ' . 
ActMly C fnumbor^) alphubet, reading, 
l;ingu^»ge Oevelopn\0ht) ' 
AduU wJth .sntall group in academic 
^icllvltl^» 

Adull Infarmlng chi'd using Symbolic objects 
.Vlull direct request followed bv child ' 
response followed b>' adult cbr recti vc feedback 
Adult direct rcquesi followed t^- child 
rcsi)onfc foljo^ed by atfuU acknaw ledfren^ent 
: Adult <liroct request followed bv child 
response followed bi" a*dull praise 
Adult pr:4l^e to child • 
. Adull ucknowl^emf nt to child 
Ackdt positive eorrchflve feedback to child ' 
AduU interaction with oiK^ pr^wo children 

■ S'cw York University 
Activity' t (tabl« ganr.es, guessing ganjcs, 

working pufiles) . a high 

Independent chlfd activity high 

.\dult praise to child high 

. Adult acknowledgemetrt to child high 
Adult positive corrective feedback to child ' high 

Adult Infraction with smalt group' high 

Child Initiates fnteractlon wUK other child high 

Child cooperates with other children" higl) 
High/Scope 

Activity tJ^group time, sharing, rest, 

sior)', singing, dancing) ' high 

Activity C rnumb«rs, alphabet, reading, 

.language developtrerit) , low 

Independent chlfd aetivll) high 

Adult informrng child using symboTle objects- low. 
Adult Inf^rmlDg child Using concrete objects,: 'high 

Adult choice request to child % ^ high 

Adult acknowledgement td child high' 

Child self-Instruction using symbolic obje^' low 

Child >clf-instructIon using eohcrete objects high 

AU nwtlon ^ - high 



SEVflN GLOBAL VARIABLES (FACTOjRS) 



FACTOR 1 



V Programme'd Academlb I ns truc t ion 



V^r^able 




No. 


.■nioadlng 


9 


'• ■ , . , 
-.38 


li 


' .15 


21 ' 


.83 


23 


' .82 


27 


.*70 


V -4 5 


•72 


47 . 


.78 


'52 


.68 


'63 


.63 



/ 



beBcription ♦ 



Alstlvlty \: lunph • * 

Activity Cinumbere, reading ^ • 

Adult with small group In Academic Activity 
Academic activity 

Aide participating In academic^Bctivity 

Adult pr^ise^to child redpons© p. 

Adult request, Chile! r$S||)ons©, adult acknowledgment 

Adult praise to child / ' ^ 

Adult interaction with small group ? 



The variables with heavy loadings on this factor, are heftrlir identical 
to the variables loading on a Progra.nmed/Acad^^^ factor'found in earJ ter-^ 
studies of the same group of sppnsbt*s^V. In a classroom with 
a high score on this fac^tbr one should expect to flrfd the'adults; bpth 
teachers and aides, engefged vvith^hUdren In academic activities with 
small igroupsi Adult praise or acknowledgment would^ characterize the 
interactij^ns. 



FACTOR 2 > V 
Individual Children in a Wide Variety of Activities 



Variable 

No. Loading 




ti6rt 



6 


.24 


Adult/child 


ratio " , 


12 


'.39 


Activity Di 


natural," world 


13 , 


.57 


Activity B; 


games 1 puzzles 


14 


.65 


Activity P: 


arts, crafts' 




.45 


Activity G: 


Jblocks, triioks 


le 


. .29 


Active play 





20 



Variable 



No.v 


. Load Ing 


1'8 


.49^ 


20 - 


.66* 


34. : 


.90 


25 


•74 


26 


.59 


28 


.80 


30 . 


. 49 


32 


,45 


40 


.-•34 


'v 


.40. 



Table 3 (continued) 

FACTOR 2 (continued) 

' > " . ■ ■ ... ■ ■ ' ■ 

.♦Description 



Adult with small grip>\ipf ' . ; • 

Adult wUh one or two chHdre{i In Activity C or D . 
Wide variety of activities ^ 
Independent *ch41d activity V 
Adult with one o^ two <!htldren 
Oroupings of one child ^ v * 

Small groups ^ *. 
Adults l;i^^ldssrobm inanagement without children 
Adult /informing xjhild ^ 
Elaborated child responrse to choice i^equ^st 

^ The occurrence of a wide Variety of activities--such a3 gaftic 
puz:5les, ^grts and crafts, a'nd groupings of one'dhil^ aloite or on^ 
children with an adujt^-are most heavily loaded on this factor^ 
room wrth-a-hlgh~score on this factor would, probably most^^lo¥eiy^ 'c^^ 
spond with the, common conception of a7i#^*open*^ classroom. ; - 



FACTOR 3 , 

. . •. ■ : ■ • ■ / A- 
Adult Feedback to Children 




Variable 




No. 


Loading 


41 1 


.57 


1 

_ 4? . 


^69 


43 : 


.79 


44 


. .82 


46 


.78 


48 


»83 


53 


.81 


j 54 . 


.61 


',,56 . 


,56 



Desoriptipn 



Adult request or command to child 
Child response to adult/ request or command 
Adult corrective feed b?idk to bfiild response 
Adult acknowiedgmenl to chi'ld response 
Adult request* child re^sponse, adult acknowl^gmoftt 
Adult request, chil^d response, adult pr^iise 
Adult acknowledgment to child 
Adults positive corrective feedback to child 
All adult corrective feedback to child 

' The factor is composed of variables describing sequences of action 
*bi^tween adults apd children. Variables with high loadings Include adult 
feedback to children. 



Table 3 (continued) . *; 

V" ■ " " ! = ■- '; ■ ? ' ■ ■ ■ ■ '■ ■ ' ' ■■ ■ . ' ■. ' ■ ": .. ■>■■;.■■■ ; ■" ■ 

FACtOR 4/- ■■■ /r.;/^.;'^ 
^ ^ Poblblye Choice Requpst 'Inteyaotiotf - 

Variable., .'' '-^-v: • ,. 

No/ Loading Description 

■/.(#• . ■ _ • ■ . ■ ■ ■■ ■ ' 

49 ,77 ^ Adult choice r^equest . ' i / 

5.0 * , .78 Child response to open-ended question . - 

61 >,57 Child self-expresslon, comments 

66 ;51 * Adult positive behavior * 

'73 , ,50 Adult to .child positive touch 

80 - 51 Child InteralDts with machine 

Adult choice reqOests^ to, children and children's responses load 
highest on this factor/ Variables also loading on thls^X^^to involve 
positive behavior on the pa^t of adults toward children, 



y 



FACTOR'S ^ 

^ I ^fegatlve Behaylor 

Variable ./ ^ 

No. Load^hg ^ . Description 



55 


<50 


AdulV negative corrective feedback';^ 


65 


. '/.56. ■■ 


Adult negktlve behavior 


67 


/ .78 ^. 


child negative behavior 


71 


/ .38 


Child noh-verbal.' 


74 


'■/ .. '..03 


Adult-chlid negative touch 


76 


.68 * 


■ Child gives negative touch 


79, 


. .26 


Child refuses/rejects adult 
All motion* * 


$i 


. 42 


/83 


.85 


All negative behavior . ' 



/ All adult and child negative behavior variables loa(J on this factor, 
The fact that the mbtlbn variable loads oh thl^ factor probably indicates 
that moving around the room is associated with children pushing and shovr 
Ing and with adult negative correctlve^eedback. 
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Tfible 3 (concluded) 
FACTOR e 

s 

positive Behavior 



Variablie 





No.. 


Loading 




Description 




60 


-.47 


Child 


asking question of adults 




68 


.76 


Child 


positive behaViot' , 




60' 


-.48 


. Child 


initiates interaction with 'adult 




70 


-.89 


Child 


initiates interaction with child 




82 * 


.80 


Ail positive behavior 




It is difficult to find a psychological or educational interpreta- 
tion for the fact that positive behavior loads positively on the factor 
and cl^ild-initlated interactions load negatively. It is possible thaC the 
positive affect 1^3 observed most often during story and group ^tl**te when 
close child-adult interactions are rare . 



Variable 




/ No. 


Loading 


* ^ . 
19 


'90 


31 


• .50 


64 - 


.76 


77 


.47 



FA'cfrOR 7 
Adult witt\ Large Grpup 

, : Pescription 



Adult with large groups 
Large groups 

Adult interaction with' large groups 
Adult helps child 



This factor is self-explanatbry , The teacher/child interactions 
are teacher talking to the whole - class ;j.nd teacher helping individual 
children. 



iAnalydls of sponsor Differences 

Expected Ditferenoes ^ .^^^^ , 

Before exanilnlng any data, the sets of seiedted implem^ht%tloh varia- 
bles generated fbr each sponsor Were displayed and sponsors Nvere grouped by 
similarity of selected variable sets • , If / for w^mplj^ two sponsors have In 
common most of the variables chosen to reflect classroom processes ahd be- 
haviors Important to (he modely they Were placed in the same group* The 
programs of these sponisoif s would not be expected to differ greatly on these ^ 
chosen variables. This analysis, then i groups spongiors by theit classroom 
objectives, as expressed in GO variabte^^ . 

pi^ser Ved Differences - 

Analyses of variance and multiple range tests were performed to com- 
pare sponsor data on the full variable set and on the factors so as to determine 
. the nature of the observed differences among mo<flels, and the number of varia-* . 
bles on which each of the models differ significantly froifi. others was examined. 
From these comparisons, it is possible to address agairt the question: Are the 
models really different? 

This question is also, to Some extent, a question about implementation; 
That is, it can b^ argued that if sponsors differ reliably from one another on the 
69 variables , then we have, a grosl' indicator that PV has been irtiplehiented . 
That is, PV, as %gt*oup of programs different from, o^ another and different 
from NPV, has bf en bperationalized in the HS ceht^ 



In comparing sponsor process means using the analysis of. variance, V 
it should be remembered that a significant E test indicates only Uiat a*differ- 
enoe exists . Unless there are only two treatments, the F-test yields little 
informatioivregarding the nature of the difference i to 
highly significant' restates only that the U sponsors are not the same on the 
measure examined. It does not indicate that each sponsor differs from every/^, 
other or that only one differs from all of the others, or that half of them *^b^e y 
essentially the same and differ from the o^her half which are also essentially 
alike. To answer these kinds oi questions, other a posteriori tests have be^n 
developed. One of the mo;jt useful in probing the nature of differences in treat- 
ment nieans foUowlng a significant overall P is the q-statistlc used in a range 
test.. The particular nTLethod used With these data is known as the NeWman/ 
Keuls procedure* In. brief , this technique utilizes a matrix of differences 
between treatment means to enable a q-^test of the difference between aU pairs 
of means, There are several alternative procedures 1^^ 
see^ms to offer a good balance between power and conservatism^ 'it keo'^s the 
level of significance equal to alpha for all ordered pairs of treatnieht compari- 
sons however many rank steps apart they may be, and using a harmpnlc mean, 
n can be used in comparing tlie unequal sample sizes contained in the present 
study, , ^ V ' 



Ahailys)^ oflr^lemehtatlon ■ - . . 

. 1^ 

tlon. Thoso two tinalj^se^ correspond tp two Impottant and related defining 
reconditions fot imi^lement^ conslstejicy"^between sUte^^ 

bbserved classroom evehtSj and 2) cjohslstenoy among a sponsor *s sites . v In 
addition, a cor oUaVy of implementation, fall-to-s^rlng consistehcy , is examined; 

Conslsteiiicy Between Program Objectives "and Classrpoiy Events ■ 

Evaluation of mo^^^^ 

iniplemintaUon variables generated to reflect a sponsor *s iiYipprtant ciassropm 
processdst, and child behdvidr patterns t The full 69 -variable set '^icludes many 
, vat'iabtes whl'ch are not relevant to 6ach sponsor * A sponsor 's frequency bh . 
such variables, high or lowv is not pertlnen^^^^ 

model is. b^ing Implemented in the classr^ As an exampleV the ffequ^^ncy 
per day of Var*iabl6 9 (lunch, snack)/ Is hot a cruqial aspect of any spprisor's V; 
educational i^rogr am. Implementation must be judged on the basis of observed 
frequencies on program-relevant var^^ ; i 

The selected implementation varla ' 
spi^risbr's classrooms are expected to be high or low, The range tests men- ' 
tioned above yield ong measure of high and low ^f^ Frqm the spbnsor 

rankings by mean frequencies on each variable, relativelylhlgh and relatively • > 
low frequencies, can be IdiEsritlfied, ^ 

- - —"^^ Another .means of identifying a frequency as high or low is to utilize an 
"absolute^* standard. This standard .was generated for 24 of the 28 selected 
implementation variables, Four bf the 28 Sei^^ 

(Variables 38, d9, 57, 88yare not usable* due to unreliable use by ^ . 

of tiie^'^How codes, " Sy (symbolic objects) and O (concrete bbjects)^. ^ ^ v- ^ ' 

I $ince the PV sponsors' programs are meant to be improy 
regula?* or non*sponsored curricula I it se^ms mbre ap^ 
sponsors' classroom events to these classrobms . 



Thus the '^absolute'' standard was derived from the observed spring 
frequen9ies of all 54 non-filanned variatioh conaparison classrooms, For e^ch 
of, the 24 variables, the ftequencjies of lhese^54 classrooms were rank-ordered 
and divided ihtb quartiies . The frequencies obtained by PV classrooms,. sites, 
or sponsors on each of these variables were compared with the NPV distribu- 
tions frequencies falling within the first quartile were then designated as Ibw, 
and those wiHiin the fourth quartlle as high. 

Using this standard, an implementation score was calculated for e 
model by determiriing the quartile rank of its overall spring frequency oh ?ach - 
r of its selected imj^lementation variables, and then summing these and dividing 
by the highest possible score for that spohso^. For example, a sponsor who 
should score high (quartile 4) on five variables has a maximum possible score 
of 20 (5 X 4). However, his actUal;score may be 18 (4, 4, ,4, 4, 2), bividing 
20 (maximum possible score) into 18 (his actual score) gives an Implementation 
score of 90 percent. ^ 



0 

RJC 



( 

■ > 



Nine sponsors"-FVV, UP, BC , UO; UK, H/S, ED^ UP and RECr-were 
included In this analysis . The Florida and JEnablers models were excluded 
because they do not stipulate classroom events, sol that the COI panhotbe used 
in assessing their prb^am implehiientatlon. NYlMs also excluded but for a 
different reason? the NVU sitjB was not obseryed In the spririg of 1971. ■ 

\ ; Test of Sponsors' SiteHo-Site Differences In Frequency of Variable * 
^ bccurrence a nd on Factor Scores ■ • ^ - ■ '.■ 

■ ' V ■ -r.--' . v ..^-/.v:- 

-An analysis of variance for site efjfects was perfornied using the full 
.s.?t of 69 variables » Sitejnean frequencies' on the selected variable sets and 
factor scores vVere^xam'lned for consistency across sites, wltliin eaibh of the 
above sponsors with more' than one site. This means that UP and REC are not- 
included in this analysis because neither has more thafi on- site. 

The second important criterion of a well implemented model is one 
which is observed to be the s&me, wherever instal/ation was atteriiptedV on the 
progranv^s most relevant variables. If there is a slgnificant'effect due to site, 
then the model is not cx)nsistent across locations, and is not, by this criterion,, 
welllmplemented. ' • 

Test of Sponsors^ FallT-to-Spring Differences in Frequency of Variable 

Occurrence and of Factor Scores ,■ ■ . ^ ■ " 

^— — ^ . — : — . ; 1 — I - . ^ 

N A t-test vyas perforpied for sponsors' fall-to^sprlng differences on ^ 
the full variable set. The limited set of variables most important to each model 
and the factor scores were then examined for the direction of the change, Jf 
any, from fall to spring. Although fall-to-spring stability Is not an Indloator qf 
level of implemeritation, it can be oeen as an important charaoteristic of a^ 
program already satisfactorily implemented,^Similarly, the direction of fal]f*to-» 
spririg change, whether there vvas prpgressi6n or regression in implementing 
the curriculum, is interesting In regar(i to i)rograms lii the p^^ 
mentation . The same nine sponsors; included in the first implementation 
analysis are. included in the fall-to-spring comparison,^ 

Analysis Relating Implementation to Qutcomes 

Well Implemented Classrooms Compared with Lesis Well 
Implenlentell Classrooms , ■ ■ \ ' ■ \ ^ 

The first part pf this phase of the analys,is investigated the relatlonshlpi 
between the degree of model implementation and test outcdmes. So as to avoid 
confounding the effects^ of degp^ee of implementation with the effectiveness of 
the different models pe^ se, the analysis contrasted classrooms within sponsor i 
Unfoixtunately, this nieant small sampl^ sizes. 

" * ■■ - ■ ' - ■ ■ , ' " ' *' ! . ' " ■ 

' Within each model for which classroom processes %n be evaluated 
for implementation (thus excluding Enablers and Florida) and which had at least 
two sites with spring CO data (thus excluding UP, NYU and REC), the quartlle 
rank explained above was used to identify .^^well implemented"' and "less well 
implemented'^ classrooms. / ^ 



^ Each clussrdonv was given an inipldmeiltution percentage s com- ^ 
puted a^ expiairted tibove fov sponsbl; Imple/iientation j^cores^ /Clas$ro6nVs.wer*e' 
then tankr order ed w^l thin sponsor anci a nc^tqi:al br eal^^^^ 
the three or four classrooms with the highest and" the three or four with the 
lowest implementation scores /^^y moa/\ change ^^bres on the Outcom 
sures (ba,s6d on the unadjusted ciassr6oi!ii test scores for faill and spring supplied 
by Huron Institute) Of the ^1iigh\' impleVnentdtioii and^aow'^ Implgmentation- 
grotips were then compared by iiipans of a the^ to determine whetiier the '^hlgh'» 
groups differed significantly and whethei'/'^ilgh^Mmplementa'tlon was .associated* 
with greater gains On th^ tests. V, :* — 



Uegi'ession Analyses \ 



Jhe t-tesis mentioned'above, comparing change scores' of well hnple-- 
mented and less \^11 Implemented classrooms w^ithin sponsor, may be considered 
as a prellmlnarj^^nalysis in assessing relationships betweea implementation and ' , 
outcomes: The Hest scores were not adjusted for the effects of demographic / 
covariables and the effects of thiJ ImpleiiVentation variables themselves on test // 
outcomes-werejibt assessed, i // 

•V": ' ■ / : ■ ■ ■■ ■.."-•.f-. 

: ^ ' In the second phase of this inye^ several regression analyses // 

were performed relating classroom process variable's to fes t outcomes ; The ji 
first three analyses did not d?al with the relationship between the degree to which a 
sponsor could implement his program f/nd the test scores obtained by ch II drenyin 
his program. They were designed to. determine whether those process variaW^^^ 
that were used to measure degree of iiijplementatlon are the same'processesy ? 
that determine differences in test performance. The question was; how muOh 
of the.yariance invest scores is explained by the background characteristic^of " 
the.children and how mucli-ls left to be explained by the implementation variables? 
In other words, are other. classroom process variables ^able to account for^the 
test scores? . • . // ' 



Then, using the regression "MODELS, /Vhypotheses were tested to 
verifyj^e preliminary findings on the earlier question: do well implemented 
classrooms have systematicariy^dlfferent effects on scores than less w^ll im- 
plemente'd classroo^r^s? Since tl^e regression MODEL includes coyari^bles, the 
results this time are in terms of adjusted effects rather than simple ^aw change 
scores. ■ - ' \ ■ ' " n: \'. ■ . /,/ ' ' 

. The last question a ddi' ess 0d is whether the lack of.r"striking. effects" ' 
for PV is due to lack of implementa|;ion of sponsors^ programs. ^ 

Huron Institute supplied puftphed card data containing dem 
informatioh from classroom roster^, parent interview .data and pre- and post- 
test outcomes means by ciasisroom. From these data and the COI variables/ 
several multivariate linear models were constructed for regression analy,sis 
and hypothgsts testing. \Each model is described below, 

MODEL J - Effect of Demographic Covariables on Test Results -- 
MODEL 1 Is designed to determine the amount of variance in spring test out- 
comes accounted for by various child and family characteristics, taken from 
the classroom roster and parent intervie\v^^i3«i[^ test scores. Seventeen 



si^ch variables, expressed In c 
46mograjphlc and pre-tost data 
televanee (e.g. i since only wl^ 
jpopt-subsco res were omitted) 



fduced to the nine opVaHables 
(1) ^feari age dHhll 



lassroort) moans, wbre chosen from the 
prpvlded^by Kurort I^tttute on the basis of " 
ole test sVor$6 are being used, aH pre- and 
and Bubjeb tlve ly J udgeapowQ r t rt predict Ihg test 



ioutcpmes^. In addition, posstWle covarlables thpt woujd adjust the test outcomes 
|for level.of Implementation were aec^sarlly exclu^liBd. 'this list was later re- 



tsted b^lovv* / 
ren in months 



(2) Percent havinglikd previous pV^ j - 

. (35 Percent English first language J - ^ 

"i;^ L (4) Percent non-white ' f 

' (5) Mother's education level ^ j > 

(6) Mean total 3D pre-score / . • ' 

(7) Mean total 4A pre-score ^ ^ \ 
. ^ (8) Mean total PSI pre-score ^ 

• V (9) Number of valid pre- and post-PSIs » v % 

These nine are the independent variables in MODEL I, Th0y are used 
in all subSsequent MODELs but are referred to as covariables, Th0 dependent 
variables in all MODELs discussed in this and subsequent chapter^ 6f the report 
are the spring classroom mean scores on the NYU 3-D, NYU 4- A, and PSL . 



^ . The hyp^thWes, in the order tested, are: 

(1) The covariables, as a unit, significantly affect , the test out- . 
comes, as a unit (one hypothesis and test) . y 

(2) Each covariable, considered separately , affects the test ^ \ ' 
outcome, as a unit (17 hypotheses and tests) I V 

(3) . Each. covariable considered separately affects each t^st 

outcome considered separately (17 x 3 hypothieses and tests) . 

• ' ' ^ ' ■ ' \ ' ■ -^'^ ■ ■ : /■ \ ." 

. MODEL 11 - Effect of Implementation Variables on Test Results — Im- 
plicit in the question qf whether implementation of progranis affects child test 
performaince is the assumption that the criteria for implementation, i.e., the 
selected implementation variables, a MODEL I 

blvestigates the effects of the 24 selected variables on adjusted test'scores. 
The selected variable list^ppears in Table 2* The hypotheses tested are 
listed belowi given the effects of the coyariables: 



(1) The implementation variables as a unit affect test results as 
a unit (one hypothesis and test). 



a-. 



\ (2) Each Implementation variable considered separately affects . 

i the test results considered as a unit (24 hypotheses and tests). • 

(3) Each fmpldmentatloh variable, considered 

eacK test result Qonsidered separately (24 X 3 hypotheses * • 
* \," ■ ■ , aitid test^)i '. i • V -y^y -^^^ ''■ \"' j-'- - . 

ji MODEi III - Effect of dth Process Variablea oh Test ReauUs ^-Thls 
analysis j^rields the variance W test outcomes which cftn^be accounted for by nine 
addltlon|I proces over and above that accounted for by the covar tables . 

and the 24 implementation variables. m^'T^^ additional variables were selected" 
on the basls.of general educational theory relating ihem to test outcomes and *^ 
from results of previoijs arialysesv^l ; These nine variables! are listed below , 
(For operatipnal definitions of thesie and the them, see 



B and C. ) 


# ■ 




Variable. 


i4! 


Activity F (arts, crafts, cooking, sewing, 
pounding) 


Variable 


23: 


Academic activities ; , 


Variable 


27: 


Aides' partloipatibn in academic activities 


..Variable 


50: 


Child response to adult choice request 


Variable 


60: 


Child asking questions of adults 


Variable 


61: 


Child self-expression t general icomments 


Variable 


80: 


Child Interacts with maichlne 


variable 


82:", 


All positive behavior v ' 


Variable 


83i 


All negative behavior ^ 



The hypotheses tested in MODEL Itl^we Usted belowv given the effects 
of the covar iables ancl the implementation variables j 

• • - ... ,.',-„■. ... . ' 1. . . . . r " • ! ■■ " ■ ' " 

(1) The additional gener&l Interest y^^ * 
results aji a unit (one hypothesis and test) . 

(2) Each variable considered separately affects the test results 
considered as a unit (nine hypotheses ^nd tests)/ 

(3) Each variable considered separately affects each test r 
considered separately (9 x 3 hypotheses and tests) , 
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: MODEL IV Effect of .Global Factors on Test Rosults- ^MODEL 
determines the effect of the seven factors; described In Table 3 , on adjusted 
test outcomes / The hypotheses tested are |^ 

(1) The factors as a unit affect tesl results as a unit (one 
hypothieals and test), ; . ^ . 

' (i) Each factor considered separatel^^ffecls the test results 
considered ,^s a unit (seven hypotheses and tests) . 

(3) Each factor considered separately affects each test result 
considered separately (7 X 3 hypotheses and tests). 

MODgL y Effect of Level of Implementation oh Test Results 
MODEL y Is % re-test of the preliminary Analysis contrasting \v611 arid less 
well implemented classrooms within sponsors Investigating whether the level 
of implementation is related to outcomes} however, Model V uses adjusted ' 
outcome scores; i.Oi , all-covariables are entered Into the regression equation* 
The hypotheses tested were: 

(1) The eight contrast variables considered as a unit affect test 

- . results as a unit (one^hypothesiip and test)* ^ 

(2) The eight contrast variables ciShsidered^separately affect 

the, test results as a unit (eight hypotheSOB^ and tests) , , 

(3) The elgl[it cphtrast variables considered separately affect f 
the test results considered separately (8 x 3 hypotheseS ^ 

and tests). • / " - ^ v 

MODEL VI - Contrast of PV^ajid NPV Efffects oh Test Results -^This 
analysis examines thie relative effects on adjusted test scores of all sponsored 
(PV) classrooms and of all non-sponsored classtooms/ The hypotheses tested 

are:. . '"v ; ^ - ■ /.* , . ;■■ ■^ - ■ / 

(1) PV classrooms coht|*ast with NPV classrooms In effects on 
test results as a uiiit (one hypothes^ and test). 

(2) PV classrooms contrast with NPV olassropms in effects on 
✓ test results considered separately 

S Summary of Regr ession Analyses- - the use of -sets of variables in 

the six modeW descrlbod above is sujiijmi^l^^^^ in Table 4/ 

" In ^e analysis of M;pI)ELs,; the fall and spring classr6om scores on 
the yariaWes and factors wei^e CO 

classrooms that were missing data on any of the variables concerned were 
excluded from the analysis. \ * : 



SUMMARY OF REGRESSION ANALVSES 
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* The multivariate linear models constructed according to ^^^^^ 
Table 4 are of the general form: 



X S + € 

m m 



For example, the multivariate regression equation corresponding to MODEL 
II (effects of implementation varikbles), ni =2, \an<i4he equatibh is interpreted 
by referring to the covarlables and selec^d^inipl'emen^tion variables. In this ; 
model, Y is an n-by-'4 matrix of observed values on the four dependent varla- " 
bles (spring test scores) where n the^numbets of classrooms . .Xi is the 
h-byTl7 matrix of observed values of th*e povariables and J^o is the n-by-24 
matrix* 6t the observed value3 of the implementation vari^ibles • Bi and B2 
are the cor responding! matrices of regression coefficients that are estimated by 
standard lea^t squares techniques* / € lis the n-by-4 matrbd of residuals*. 

those ntodels where contrast ''effects'* are involved--^ such as the 
contrast effects of high versus low implemented classrooms-—then the values 
in the X inatrix are dummy variables such that-the corresponding B matrix 
estimates the desired effects. 

All computations were performed by the BMD XIV progr^^ 
Multivariate General Linear Hypothesis'**^ under the usual assumptions . 
ever the number of dependent and independent variables are both greater Hhah 
one, the program computes an approximate P statts tic which is used in assign- 
'ing, significance levels to results. In other cases ^ the F statistic exact. ' 
The reader Interested in further details on, theBe techniqaes is referred to / 
Dixon43 and Rao*^ . V : 
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' ; . m RESULTS 

y This Section desertbes the results In the following order. *The sponsor 
j^l/feren^es are first analyzed to discover whether the comppsltlon of selected 
sets variables, chofiett to detect mode'l ImplementptionVi'eveal ll^fdifferent 
models or whether,, becausfe many variables are critical to several models, 
thesevvarlables could only be expected to reveal differences between major - 
grou}^ of sponsors* , \ ' • , 

^^^^^^ actual observed frequencies ot occurrence on every one of the 69 

variables 'aro ehterea Into the analysts to dete^mjnj^ slmUaritl.es^a^^ 
among 611 sponsors r Scores 6n the seven faetbVflTH't'e exanilne^ for dohslstency 
wrth findings Qh ihp entire varl^le* set, . " ; ' 1 _ 

. Kext fi an Investigation of degree of Implementation dcN^^ied as consistency 
between sponsor claslrootri jinte)itlons and obse^rved classroom events, and as, 
consistency across gttes within sponsor. A charactearlstie related to success- 
fyl implementatlonrf^ll-^to^sprlng consistency, Is al^l^^ 

r The relationship between the degree of lmplemer\tatlWartd child 6 
Us measured ty achievement an.i cognitive tests, is .also investigated,. X^iertes 
of regression anai>^es examj^es the relationships between the Implementation 
variables, other process variables, and the factor scores and test results. In • 
addition! the effects of PV and NPV on the test oQtcomes are contrasted. ,v 

An^ysis of Sponsor Differences • 

Expected Sponsor Differences 

The selected sets of variables described In tl^hapter II were examlned'to 
determine whether there were PV program^dlfferences In terms of currlcutum 
.dimensions. These individual gets of variables tepreseni^classroom processes 
considered tb be'thcf most important descrljOit^^ sponsor's program. 

The'Selectecl variables (shown in Tabte'SyAvere examined to see hdw n\ahy dif- 
ferent ifroups, or clusters, were formed by the 11 sponsors/ if two or niore 
sponsors shared alt or nrvoef classroom process variables (I/e* , If high fre*^ 
quericles wepe expectedohthe same variables), they weiftf coni^ldered essentially 
the same, at ledst In terms of their classroom objectives as the^e are charao-v 
terl3?e«l by the' GOf. That is, they have more major curriculum elements in 
common than otherwise;. : 



^Enabler-B Is already distinguished because pf its difference on another dlmen- ^ 
slon: It does not claim to be a single model since the ''sponsors'* are actually 
sev^af different consultants who work with centers. . * ^ 
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Ofte eJl^ctaUdn was that, the progran^ into three cVusters-- 

correspondlng roughly to the typology aescrlbed for^ Follow Through by Maccoby> 
h\id Zeliner 4o as follows: ^ . * 

(1) /Programs oriented toward behavior modification! Performance on 
InteUectual tasks is thought of as a. class of behavior subject to the 
^ Sft^e jaws that goverh'other kinds of behavior, Editcatlori U> or 

■ 8h(^uld be, .a process of reinforcing chljdren fot* flie' desired behavior/ 

' (2)* Programs oriented toward cognitive growth: Pekorrtiance on Intellec-' 
[ ' tual tasks is thought of as reflecting the level of develo^Dmetit of mental 
- structures and pperatlohs,. Education is, or should be, a process of 
faotUtatlng the tformal stage-wise growth of these ^^rocegses; 

(3) Programs oriented toward self-act^aUzatloni Performance. Ort Intel- 
. lectual tasks reflects whether a child has chosen to ijnast^r 'the tested- 
for contents In pursuit of his own goal^> Kducation is/6 should be, . 
a^procg'gs Of stimulating the chlLdxintell^tu^^ 
/ him with a ^^nge of experiences ana materials appropriate to his 
exlstjtig skills, so that he can leg^yft to become competent m his own 
physical and social environment. , ^ / ' ' -— — ^ 

These three clusters, however, did not clearly emerge. Only two loose clus- ' 
ters of sponsori^Tyere distinguishable. Th^i most Important variables distin- 
guishing these clusters are shown In Table/6. V 

These clusters are by nb means eithei* discrete or^mutally exclusive, but 
are representative of differences In methodological emphases. The models 
found In Cluster II, for exampl|rt must ci^rtalnly employ concrete objects In 
the classroom e[t times; however, :they p^&ce primary emphasis on the use of 
symbolic materials, whereas the Cluster I sponsors place greater emphasis 
on the use of concrete objects. 

The modelk that comprise* Cluster 1 are; FW, UA, BC, HS, UF, ED, NYU, 
andREC. TheTmodels in Cluster n are; , UP, UK, and UO, Cluster lis less 
firmly deflnedlthan Cluster 11. Although sonie models in Cluster I, aiuch as F\V 
and ED, would be expected to be at the extremes on the dimensions suggested by 
these variables, other cognltlvely-orlented discovery models, such as the 
, Piagetlan UA and H/S programs, would perhaps more likely be found toward 
the middle of the range on the rjtevant variables. * 



Y 



♦The Follow' Through sponsors who were also PV sponsors In 1970-71 were 
classified ad follows: first category, U. Oregon, U. Kansas, U. Pittsburgh; 
second category, NYU, U, Georgia, U. Arizona, High/Scope and perhaps 
Bank Street; third category. Far We^t and EDC.*^' . . ^ 



■ ■ . . \- Table .is,,,/ '. ' ' > : . ' 

VARIABLES SHARED WITHIN: C LUSTERS 

I Clustey I» Cluster U . 

Modelsj PW, UA, BC, HS, UF, 1 

ED, NYU, REC> . Models UP, UK, UO 

Expected high. frequencies oni ' Expected :hlgh jfrequencies on: 

a) Adults^nstruQting Nvlth concrete 
objects (3Sy ' 

child self-lnstraction with 
conoreto objects (58): 

b) Indepeodent child activities (25) ^ 



c) Wide variety of actIvUlQ8^(44)_ 

d) Adult choice question (49) ^ d) Adult direct questions followed 

V ^ by responfie, by feedback 

- - : . (46, 47,.^8) 

^The Enablers model, as explained In Chapter I, cinnpt be classifledf for It 
Is whatever a specific community or site wishes it to be^ * ' ^ 



Thus the 11 models form two patterns/ One pattern, represented by Cluster 
I, emphasizes such.varJables as children working or playing Independently of " 
adults, learning through manipulation of concrete objects, expertencihg a«wide 
variety of actlvltie8» and adults asking children choice questions, to elicit ex^ 
presslon of feelings, opinions or preference. The CUster 11 pattern doscrlbea 
programs where emphasis is placed on adults instructing children Vjflth symboUg 
materials (e*g. , printed numbers, letters or words), adults worklr^ directly 
with the, children in academic br^ preaca^eniic activities (math^ language develop^ 
ment), and adults asking children direct questions to ellolt informs 

Oft this basis alone, Jibwever, it earniot be concluded that the IT pV sponsors 
represent, Only two pre-school treatments. Although originally conceived as^ 
providing just cUssropm curricula, it is now evident that a total de^lnltio 
most models must encompass other treatment elements* The COIi then, can 
measure only a part of most sponsors Vprog^^ though certainly classrooni 
processes are tlj^most Important componeht In alm^^ 

In addition, althpugh the Q not appear widely diversified In terms 

of the selected Ihiplemehtatloh varfaljles, mo^^e dlffer(^h may be revealed 
through actual or objaerved frequencies on the full set of 60 variables. . Sponsors 
differ In their ability to provide researchers with a"c<^^ operational des- 
cription of an Ideal model classroom, making IdentiftcStion of implementation * 



a) Adult ins^ctlrig wlt^^ ^^^\/^ ^^^^ 

b) AdultsJ^wlth one or ^^t^ 
In Academic activities (20) • 



^iults withsmallgroup in 
icademlc aqtlvUies (21) 



c) ; Academic activities (11) 



tiviuee (S 



variables Jnore difhcult for some sfwrtsors. With the exception oif two models, 
sponsors apparently were unable to provide specific written descriptions of 
classroom activities and processes In th% first year of the PV experiment, and 
this remained essentially true even during the third year of the study. Not all 
the models chosen for Inclusion In the PV study were. well defmed and there is 
evidence that /most models have evolved or been changed somewhat during the' 
experimental perlod.^6 ' , '] 

* The difficulty arises In part from the fact that sponsors differ. In their ideas 
about how to specify various aspects of the model, such as, how teachers should 
Interact with children, and what materials should be used afid in what way. 
Moj«eover, the sponsors differ about the manner and extent that their methods 
should- be Imposed In a site. This can be Illustrated by the philosophies of two 
of the sponsors, EDC and the Uttfverslty of Pittsburgh. EDC uses the a'dvlsory 
approach to. program implementation: ~ 
' ' '.. '. , ' ■ , * \' ' ' 

'•EDC policy is to work. . .with individuals who are ready for change, 
. who have a sense of the directions In which they want to move and 
who need and request advisory help. The advisory team does not 
attempt to Impose specific fdeas or methods. . . "4'^ . * 

in contrast, formallEed and Indlvlduadzed teacher training programs and on- 
going sponsor nionItoring:of classroonf Implementation are important parts of > 
the University of PKtsburgh model. ^ ' 

Since this report deals with the- Planned Variation models solely In terms of 
classroom processes (as defined by COI variables) the, degree to which a soonsor 
was able to specify his model probably has an effect onfthe evaluation results. 
For those sponsors who do not attempt to shape classrdom events at the level it 
is being measured, the evaluation findings Way not do justice to their model. 
However, each sponsor has a stated philosophy, and It idl appropriate to investi- 
gate the actual differences among sponsors. \ \ 

■ ■ ■ , ' ' ■ 'X ■ 

Observed Sponsor Differences 



« " Variable Differences 

* ' The analyses of variance for sponsor effects, performed on the total 
variable list and displayed In Appendix E, show that sponsors differ significantly, 
(p< . 05), on nearly all variables. Of the 69 variables examined, sponsprs dif- 
fered on fall observation. data at p<.opi on 41 variables? p<.01 on eight, and at 
p <.d5 on seven. On spring observation data, differences were found at the 
0. 001 level on 36 variables; at the 0,01 level on 15 variables; and at the 0.05 
level on nine. 

Regarding these dlfferences;>;Cl> points should W emphasized. First, 
the analysis of variance on a varklHTe wcwld show ^Igniflcahoe even If only one 
sponsor were different while all others were essentlallyv^iinilar. It is* therefore 
not surprising that a significant difference was found on so^many of the variables, 
and it is for this reason that the multiple range test was al^o performed so as. 



to determine exactly which sponsors differed fronv which others ort each variable.. 
Seoondlyi it was mentioned earlier that distributions of classroom scores on 
these variables frequently do not satisfy the assumptions of normality and homo- • 
genelty of variance basic to parametric tests for differences between means. 
For some sites and sponsors, the clf^ssroom dlstrlbullon on many variables was 
J-shaped with the mode at zero, It has been shown38, 39 that non- normality does 
not affect'the F-test extensively, that the J-dlstrlbutlon yields results remarkably 
similar to the Ideal norm» and even that in cases y^heve both normality and .homo^ 
genelty assuniptlons yere not satisfied/ the alpha error llvel Increased only . 
slightly, Nevertheless, on these tests, alpha levels < G.Ol shpuld b$.regarded ' 
merely as indicative of probable difference arid not as jstrong evidence thereof. 

' The r.esUlts of the multiple range tests are displayed In Appendix E. 
The tables show the rank-order of sponsor means on each variable^ and groups 
of sponsors that do not differ significantly from one another ar^ Indicated by 
underlining; It 1$ from close examination of tNese results that the reader can 
obtain the best Insight Ihto sponsor dlfferencio on classroom behavior variables. 
It vyould not be reasonable to attempt to verbally summarize the wealth of informa- 
tion contained in these appendices; To describe, variable by variable, the dif- 7 
ferences between each sponsor would require.V(>lumes. However, the range test; 
information can be summarized In table form. . ' 

Table 7 displays a relative measure of the distance from the central 
rank order, of Sponsors by mean frequency on each of the 69 variables; A v 
sponsor's distance score on this table differs from his average rank in that the 
same score Is given to a rank position above or below the ceixtral rank. For 
example, on Variable 6, the sponsors ranked as suown below in the fall. The 
first line gives the actual rank of each sponsor's mean; 'the third line gives the 
distance score, I.e. , the number of ranks above or below the ceijtfal rank 
(whose score Is 0). Thus, EDC (ranked I) and U. Kansas (ranked \l) both score 
five, that Is, five places from the middle. ' 

Rank; 1 2 3 ^,4 5 6 7 8 9 10 11 
Adult/child ratio Sponsor: ED, UO, PW, UA, RE, HS, UF, EB. UP, BC, UK 

Score: 5 4 3 2 1 0 1 2 3 4 p 

, Table 7 also shows the number of times each sponsor placed four and 
fiV(3 ranks away from the ceotral rank. For instance, 6, Oregon attained a 
distance score of five (i.e., ranked at either extreme oit the sponsor rank order) 
on 23 of the 69 variables, more often than any other sponsor; 

Also shown In the table Is a mean distance scpre for each sponsor, com- 
puted by dividing the sum of Its distance scores on each variable by the number 
of variables (69). The sponsors are then arranged in rank order by this mean 
for both fall and spring. For example. In the fall, Arizona ranked lowest (mean 
distance score 2. 10, meaning that on the avei*ag^UA was about two places from 
the dentral rank) and U. Oregon highest (mean distance scoxe 3.46). 
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these figu'i-'eg do not indicate thp actual degree to which a spons 
fe red from other sponsors. Although on a given variable t\yq sponsors must 
nebessarlly rank on either end (thus achloVlng the highest' distance score, five) * / 
there were often no significant differences |4mong the variable moans on which • 
the sjionsors Were ranked ^ However, ly does give a rough meusuro oY the fre- 
qae'ncy with which a sponsor Is near on6 of the extremes of the sponsor ranking; - ' 
. Sponsors with i^elatively low mean distance scores, suqh as Arizona (2. 10) and 
Enablers (2. 28J In the fall, tend to occupy median positions in sponsor variable 
rankings more often than (Sponsors with higher $cores, such as Oregon (3.43) 
and Bahk'Street (3.43), in the fall. . ' • - , 

Table 8 concentrates on the statistically significant differences between 
pairs <>f sponsors. Based on the range tfests presented in Appendix E, this table . 
presents niatripe^ for fall and spi-lng, showing for each sponsor pair the number 
of Variables which t>»ey differ significantly (thai Is, the number of vax'iabies " 
on wlilch they were not included in the same underlined group in the range tests, 
designating no significant difference. ) 

: For example, in the fall,matrlx in Table 8, PVV and UA differ sig^f I - 
cantly on just four variables out o^ the entire set of 69 variables. iFurther down 
the column, one sees that FW Is significantly different from UK on 25 of the 69 
COI. variables. , 

This spbhsor-by-sponsoriSomparison on each of the 69 
definite pSitterns of differences between sponsors, and the patterns vary only slight- 
ly on the fall and spring observations. Resutts from the spring observations gen- 
erally jrepilcate those from the falU The Information In Table 8 is further condensed 
In Table 9» For each sponsor, the table lists the other sponsors with whom he has 
the fewest significant differences and those with whom he has; the most significant 
differences, < V 

By comparing the two columns In Table 9, sponsor patterns or groupings 
emerge. / 

Six sponsors, FW, UA» BC, UF, EDO and EB, are usually found to be 
''most similar to'\each other, anci ''most different from'* the same Sponsors-- 
generally Ud and UK, Two of these sponsors, EDC and EB, have perfectly 
reciprocal sets of "most slmil^ar'^ sponsors and Identical "most different" 
sponsor ' sets. It is interesting that these two sponsors arrange them;selves sim- 
ilarly yls-a-vis the others, since the Enabler and fcDC models operate on a sim- 
ilar consultant or advisory approach to model implementation. 

The second Identifiable group includes UO, UP and UK, although this 
group's consistency Is less strong than that of the other two groups due to dif- 
ferences between. UO and UK. All three, do have common sponsofs in both 
"slmllarV and ''different'* columns^ but UO and UK do not reciprocate; rather, 
UK appears in UO's '^mdst different'^ category. ^ ' ' 

* . ' A third group revealed In this analysis is comprised of H/S and REG. • 
These tW6 models each sharo similarities and differences with the other two 
groups as well as reciprocating in their "most similar" list* For Instance, 
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: Table 0. 
SUMMARY OF.SPONSOR DIFFERENCES 



Far West Labs 
Ui Arizona / 

Bank Street 
U, Oregon 

0, Kansas 

Hlgii/Scbpo (HS) 

U. Floi'idft .» 

ECfC (BID) 

U. Plttsburgl/ 

REC 

\ Enablers (EB) 



Most" Similar To 

UA 4,4; BC 4,6; ED 10,10 

BC 2,2) EB 2,2j UF 3,2: ■ 

FW 4,4 - . . 

■ UA 2 , 2 1 EB AiiCyfA^A 

UF 10,10; UP 10,10; 
. RE 12 ii3 ■ 

UP 8,8; RE 11,11 • 

EB 2,4;;RE 7,6; UA 6,7 

UA 2,3; Ep 5,4; BC^7,7: 

EB 4,4; UA 5,5; BC. 5,5 

UA 6,7; RE 7,8; UK 8,8 

UA 5,5; EB 6,6; HS 7,6 

UA 2,2; BC 4,4; ED 4,4 



Most Differdht Fj 



UK 25,26; UO 22,22; HS\8, 17 

Up 17,17; UK 13,14 

UK. 20,21; HS 20,21; UO-19,20'' 

F\V 22,22; HS 19,19; UK 18,18 

F.W 25,26; BC 20,21 

BC 20,21 ; UO 19 , 19; FW 18, 17 

UK isiia; 

UK 

UO 12,13 

UO 18,13; UK 15,15 



JK 118,18} 
rW/3,13,^ 



UO 13,14 



^ ' First numeral indicates number" of variables On .whiQhi.they differed in 
the fflfll J second numeral' indicates hiinjber of v&^'iables d they 
differed in the spring. 1 ; 

■ ■■■ • ■'■ ' ' . ■ . \ ■ ' ■■ ■ 

H/S'S "most different" set includes BC ^nd FW In ajddltTon to UO. REC appears 
In the "most similar" column of all three sponsors/in the second group but Its 
"most similar to" sponsor get is made up of UA, Eb, as well as H/S. 

These three groups , roughly correspond to Maccoby and Zellner's three 
cliasslflcatlpns^^ which were.gene rated on the basis of educational philosophies. 
Group one, a six- sponsor group :(FW, yA, BC, UF. EDC and EB) would, for 
the most p,art, be congruent with the "self-actuallzatlpn" classification on the . 
basis of theory. (One exceptloh might be UA, discussed\belo^y,) The second 
group (UO, UK and UP) relates to the ''behavior modification*' classiflca^^ 
Th^s sponsor^roup also appears .as Cluster 11 in the preceding analysis of ex- : 
* pected sponsor, differences.. The third g;roup (H/S and REC) might be placed in 
. the ''cognitiye grpwth'''classificatIon.^ ^ - ' , 

A comnient o^egardlng the Kansas model is informative Regarding the 
differenges within the second group nientioned above. It is apparent froin the 
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fall and spring mean distance scotes (table t) that Kansas does riot routinely' 
occupy extreme positions in the sponsor I'anklngs; That is, It is asu^lly nd^^ 
found iat either enc} of the rank order of. sponsors by mean frequenbles. on th6 69 
variables, Yet, on any variable Avhere 11 does place at one or the other end of the 
rank distribution, Its mean frequency on the variable tends to be so very high pr 
low, that It differs signincantly from that of every bthet sponsor In the sample* 
Thus,; as shown In table'is, UK differs from more sponsors on more variables \ 
than any other model, although It frequently occupied central positions on rank^ 
dlstrlbutlpns of variables. 

Another sponsor whose results In this analysJ^^aTe^^ Is Arlzojia; 
In Table 7 It was seen that Arizona usually placed clo^e t9 thdy medlan in a rank 
order of the sponsors on the full 69 variable setr InjJahie 9, Arliiona appears 
In the/'most similar" column of eight of the tenxnROT spon^ and d<)es not 
place in the "niost different" set of any sponsorL The ex/)lanation of this might 
lie in an ecleptlc curriculum, that Includes clasVc$omje?lenients ^Iso found In a 
variety of prpgrajms, / 




Factor Differences / ; 

. .' . ' ' . . ' ' : , , "■ . >\ 

Figures Ithrough 7 display sponsor factor scores on the'^seyjen factors 
previously described. ^ The flrst two factors, ^'I^ogrammed academl(^^^nstr^ 
tlon'* and "Individual children in wide variety of activities, 'Vseem to echo both 
the expected and observed differences found among sponsors In the preceding 
analyses. The remaining factors, however, seem less valuable In distinguish- 
ing sponsor orientations, A brief discussion of each factor follows. 

Factor 1: Programmed AcadeniIc Jnstructlon- -Three models, ilnlverslty 
of Oregon, University of Kansas and University of Pittsburgh, share the grouping, 
content and methodology emphasis described by this factor, and the score of each 
on this factor is more than a full standard deviation above the mean. All other 
sponsors score, negatively on the factor, and three— Bank Street; High Scope, and 
lEnablers— all average 0,5 or js^ore standard deviations below the mean on both 
fall an^ spring observations. ' 

Factor 2: Individual Children in Wide ^Variety of Actlvlties- -On this factor 
composed primarily of CCL activity variables, four sponsors show substantially 
high scores on both fall and sprinjg observations, the Far West X,aboratory, ; ./^ 
Bank Street, University of Pittsburgh, and Responslye Environment Corporat(6n 
models appareijUy place conslcferable emphasis on the experiential variety or the 
Individualization of activities Implicit in this factor; Two further points are 
noteworthy about UP. First, UP Is the only model in the sample iscoring sub- 
stantially above th^ mean on both Factors 1 and ^; and^econdly, there was a 
distinct shift of emphasis in classroom characteristics! as represented by these 
two factors, during the school yeaK In the fall, -UP w^s approximately a full 
standard deviation abbVe the mean on both factors; In the spring, ^'Programmed 
academic instruction" dropped to 0.5 standard deviations above the mean while : 
the:^Wid9 variety of activities" score soared nearly three. Standarb^deyiatlons* 
above the mean, - ^ 

Factor 3; Adult Feedback to Childrenr ^Thls factor Is composed ; 
entirely of adult/child Interaction variabjes, mostly of a sequential nature and 
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involving adult feedbapk to children. It plight 6e expected that stimulus/ 
response/relnfovcement models would dominate the positive scotes this 
(actor but' that is not entirely tho ciase. ,In the fall> UK and UP had moderately 
positive scores while UO's was negative^ In the spring, UO reversed completely, 
scoring high on the factor, while UK and UP were still positive but closer to the 
meair;"^ The, consistent performers on thls.factor were REC, scoring 1.5 to 2,0 
standard deviations above the mean, and r*\V, scoring approximately 0,85 stan- 
dard deviations below the mean jn both fallound spring observations, 

Factor 4r Positive Choice Request Interaotlon- -^ Choice requests/ 
questions are distinguished from direct questions by the property of having more : ; 
than a single acceptable respons^^br reply. This factor seemed very unstably 
from fall to spring, as several sponsors radically altered their scores durltjg 
the academic year. In the fall, University of Oregon and High/Scope were each 
a full standard deviation above the mean; In the spring, they were 0,41 and 0,02» 
respectively. University of Florida also shifted from 0,30 In the fall to 0,80'ln 
the spring. Two consistent models were UK and UP, obtaining substantial neg- 
ative anti positive scores, respectively. In both fall and spring obse;:*V itlons. 

i -^ Jl Factor 5i Negative Behavior --^ Nearly all sponsors stayed close to tfe - 

mean o|ijhis variable. Sponsors scoring substantially high In the fall were Far" 
West and High/Scope while In the spring only Bank Street and possibly EDO 
appear-reiatlvely high above the mean, Th^onsletent negative scorer on this 
factor (negative behavior rarely occurred) ws RE, ' 

- ■ ^ ■ ' - ■ ■ ■ ' ■ ^ ' r ^ 

\ Factor 6; Positive Behavior -- As mentioned earlier, this Is a difficult 
factor to Interpret* It Is named after its highest loading variables, which de- 
scribe ppsitlve behavlor< but a model could also score highly on this variable 
by having a low frequency of child questioning and interaction Initiation slnce^ \ 
these va|rlables load- negatively on the factor, Thiere were no high scores 
relative to the n^ean on the,.fall observations, while two models. University of , 
Arizona and Enablers, scored approximately one standard deviation below the 
mean, In the spring, Enablers dld.a turnabout and scored nearly one standard 
deviation aboye the mean along with Bank Street, 

Factor 7: Adults with Large Groups - Positive scores on this factor were 
dominated by the NPV classrooms, which. It must be remembered, were In- 
cluded in the standardization process, yielding a mean of zero. Of the sponsored 
models, only ED.C in the spring used the grouping arr^gemehts central to this 
factor to a substantial degree. All other models tendea to score slightly negative 
and/or not widely different from the mean, . \ 

Summary - Observed, differences ^ \ 

Although It Is of great interest to see how sponsors did In fact differ 
in classroom events, observed differences among sponsors do not Indicate Im- 
plementation of sponsors' programs. In a gross way, observed differences 
could be seen as Implementation of the entire PV concept, In that; the existence 
of several classroom curricula different from each other and from NPV would . 
Imply implementation of a PV program. However, without demonstration that these 
variations are Indeed those which were planned, l.e, , that observed differences are 



consjstbht with methodological and theoretical program differences, observed dlt'-- 
.ferences In classroom events are not evidehce of model Implementation. Imptemen- 
tatlon must bo assessed In terms of classroom processes Integral to each sponsor^s 
pr'ogram, All 69 variables are not relevant to *each sponsor; Indeed, some (e.g., 
Variable 9-^Snack, lunch}^tnay not be salient to aniy sponsor nor would they be 
expected to greatly differentiate PV and NPV classrooms. Thp analyses of 
Implementation, discussed In the following, utilize selected sets of variables, 
each set generated to represent pne'sponsor^i? Important classroom processes 
and behaviors* 

Analysis of Implementation 

Consistency Between Sponsor Objectives and Classroom Events' 

As mentioned In the Introduction, there are two Interwoven crl\eria for 
successful implementation of a model's classroom processes. One criterion is 
conslstancy between the sponsor^s desired classroom processes and behaviors 
and the observed classroom processes and behaviors as measured bj<\the COL 
This consistency is consldei*ed to exist if a sponsor scores high froqu^icles 
on Important, desired process variables. ; \ 

- . ■ • ' ■ ' ' ■ ■ ' . ' ^ ' ■ ■ ' ^ ' ' ' ' ' " ■ ■ . ' ' 

The range testsVleld, for each COI variable, a rank ordfer and grouping of 
the models according to obsei*ved frequency. From this, an Individual sponsor^s 
frequency on a given variable could be designated high or low relative to the 
other PV models. However, this analysis utilizes a more absolute criterion 
for designating fvequencies on observatlonVarlables as "hlgh^*or "low^'. 

None of the sponsors can be expected to estimate the optimum occurrence . 
of any glv^n behavior per five-minute period In th^eir classrooms, even of those 
behaviors most valued in the program. Even with a thorough understanding of 
the dehnltlons of the Interaction categories, and of the procedures observers use, 
in recording their, classroom processes, sponsors could not give reasonable 
estimates of desired frequencies for variables such as "Child response to adult , 
direct ;request^|r,(Variable 42) or "Adujt helps child" (yariable 77)/ Therefore no 
truly absolute standard or expectatl^ can be formulated against which to com- 
pare observed frequencies. 

The standard, then, must be a comparative one. It Is reasonable to assume '[ ' 
that, since regular or traditional Head Start programs are the progrs^ms these 
sponsors seek to Improve upon, a higher fre^quency on desired program compo- 
nents than most regular HS classrooms and/or a lower frequency on elements a 
sponsor may wish to do-emphaslze would constitute successful Implementation, 
, Therefore, a fixed nonrelative standard based oh the comparison sample was 
generated* ^ t 

The methods used to generate the quartlle rank standard were detailed in 
Chapter n. Table 10 shows, by sp6nsor, the quartlle rank of his mean fre- 
quency (over all classrooms) on each of the selected process variables de'sig- 
natod as critical to his model. Sponsor expectations on each of these variables 
are found in Tablets. For instance, the University of Oregon was expected to 
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PONSOR CUSSWX>M OBSERVATtOS iMt^IJEMEKTATtON SCORES' 



6 AduUAhlld ratio 

10 Activity B (group time, sharing, 
re»t^ story, tlngtng, dancing) 

It Activity C. (numborf, alphaboti 
• rjoadtngi language development) 

l3 Activity t (table gantca, gue«'slng 
games, working puzzled) ' 

. 20 Adult wUh oni or two chlldrin^ * 

- « icid«mtc icttvltki 

21 Adult with ntnall group, - 
academic activities 

2 1 ^viiip vorlety of activities 

• ' ■ ^ ^ 

25 Indepcndpnt child acUvlty 

26 Ail tiU w II h offl « r .( wo c h r • n 

" ■- ^ * ' , . ■ - 

^ ■ 16 Adult' direct J'equest follomed* 

by child response fqllo»cd by ^ 
. adult corrective feedback 

17 Adult direct request follovkecf 
by child response followed by 
adult acknowledgment 

18 Ariult direct request (olloued 
by child resp'oj^Bo foil on ed b^ 
adult prals^ ^ 

49 Adult, choice request to a 
" Chllti r. . ' 

52' AduU praise to child , 

^' , ■ . . . ' * 
93 Adult acknowledgment (o child 

* ■ * K 

51 Adult posit vve corrective 

feedback to child * ' 

59 An ch? Id self-Instruction 

62 Adtttl Lntariction with ona ot two 
cMldtan* 

.63 Adult interaction *lth / 
.SBiall: group , 

69 Child Initiates Interaction 
ulth adult 

70 Child Initiates Interaction 
«lth other chl Id 

■ i' 71 Child non-verbal / 

72 Child coo()er,ates 

SI All (notion 

SUM or VARIABLE SCORES^ 

MAXIMUM POSSIBLE 

OVERALL IMPtHMKNTATION SCORE 
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3 
34 
44 
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4 
39 
48 
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achieve n high (I.e., fourth quartlte) frequency on Variable 11, '^Activity Cr-math 
reading, etc., 'Vand, in fact, its overall moan frequency does fall In the fourth 
quartlle of the quartUe rank standard, . 

Each sponsor quartlle score on critical variables is summed and divided 
by the highest possible score he could have attained to obtalman overall Imple- 
mentation score expressed as a percentage, ^ ^ 

; The nine sponsors w^ere'ranked by the percentage scores sho\vn Jjn Table 11* 





Table 11 






' OVEliALL IMPLEMENTATION SCORES 




Rank 


Sponsor 


Score 


lU ^ 


Unlv, of Kansas 


92% 


1,5 


Unlv, of Oregon . 


. 92% 


3 


REG 


88% 


4 


Unlv. of Pittsburgh ■ 


83% 


5.- ■ 


Unlv. of Arizona 


81% 


6 : 


Far West Lab 


77% 


7,5 


Bank Street 


75% : 


7.5 


EDC i 


.75% 


9 


High/Scope , • 


■. 71% 



It is interesting to note that those three sponsors \vho, in the prededing ex- 
aminations of sponsor differences/ always grouped together (UK, UO, ahd UP) 
also have three of the highest ir^iplementatlon scorOiS, This sponsor group was 
the most clearly indicated in the analysis of expected sponsor differences as 
well as by observed frequencies on CO^yarlables a Both by 

stated objective^ and observed classroom events, these sponsors are set apart. 

The reason for this and the higher Implementatlong scores Is unclear/ It 
may be due to a higher degree of program specificity (being able to define what 
goes on In the glassrooms) and the fact that their critical methodological 6om~ 
ponents are relatively easily recorded by the COI, These sponsors (UK, -UO, 
' and UP) appeared much better Implemented than other sponsors, who often are 
unable to describe behaviorally what should occur in their classrooms. The 
classroom processes of some of these models are often of a nature that pre- 
cludes objective encoding such a? ^required in the COI. Desired teacher behaviors 
may be too inferential or subjective in nature to be coded reliably by observers, 

Consistency Across Sites . 

When the PV experiment was designed, sponsors were seen as offering 
V predefined classroom progt^ams, or treatments, ready to be Implemented in 
several sites. Implementat'oh was naturally assumed to include slte-to-sit6 
replication of the sponsor's treatment, that Is, consistency on critical program 
characteristics across sites, 



Differences between sites within sponsoi* on the selected sets of variables 
are dlecussed b$low. Fot each sponsor^ a table Is Included^ showing the rele- 
vant selected Implementation variables, mean site frequencies, an overall mean 
frequency and the F - or t-statlstlc (depending on number of sites) and slgnlfl^ 
oatnce level of the variation across Its sites* \ 

For examplOt the first line of Table 12 Indicates that on Variable 10 ^ 
(Activity lB—grou{i time, sharing, rest, story, singing, dancing) there were V 
no significant differences among Far VVest's three sites In yie fall, but slgnlfi- 
.^pant differences a^ong.sltes were observed In the spring, \ 

Differences among a sponsor's sites In terms o^ factor scores ^Ill/ai^o be 
discussed In this section, (The seven factors gire .described in Table 3.) 

Fatt West Laboratory^ * ' \ 

* Varlables- -The three Far West Laboratory sites look slgnlfldUntiy 
different on several variables In Table 12. Perhaps the m9st Important/and . 
interesting, however, are Variables 25 (Independent child activity) and 52 
(Adult praise to child); Both of these variables are related to integral cbmpo- « 
nents of the Far West Laboratory curriculum, The Far West Laboratory pro- 
gram is based on the autoteflc discovery approach to early childhood education, 
Learning activities are designed to be self- rewarding as well as to help develop 
skills, concdjpts and attitudes for later application. The classroom activity 
should ^ mobile and emphasis Is placed on children working Independently of ; 
adults ?it these ca'refuUy designed learning activities. ' . 

. , ■ ' ■ ■ - ^ " - ■ - ■ ■ • ■ •, ■-•^ ' 
table 12 Indicates that, although there was signlflpant site-to-site 
variation on Variable 25 (Independent child activity) in the fall, It Is, possible 
that the sponsor was sucpessful4n helping teachers Implement this prpgram^ 
element more conislstentiy In all sites before spring. However, In the fall, 
Far West Laboratory attained the second'hlghest moan frequency of the It 
sp6ns6rs on thliSiyarlable, but drbpped to sixth place In the spring. Further- 
more. Far West "I spring overall mean frequency on Variable 25 .only falls into • 
the third quartile of the NPV standard. Although there was^reater consistency . 
across slte^ in the sprinjf) the overall freiquency of chlldren>orking or playing 
without adu|ts is not %lgh'* by definition (i. e, , fourth quartile), HoN^ever, a" 
third quartiVe ranking on this variable does not Indicate failure, sjnce a high 
level of child Independence Is probably common to many PV and>NPV programs/ 

The other Interesting variable is Variable 52 (Adult praise to children). 
The autotelic approach is premised on the belief that It Is more advantageous to 
the child for him to be reinforced by his own achievements and to develop a 
healthy self-concept from this base, rather thah to be depentlent on external 
reinforcement, i.e., the teacher's approval. Both falUand spring show con- 
siderable variation among the Far West Laboratory sites on Variable 52, with 
only slightly less in the spring, when two of the ITlte means dropped somewhat/ 
On the fall range tests, Far West Laboratory ranked fifth of the 11 sponsors on 
Variable 52, that is, had the fifth highest frequency on the adult praise variable; 
in the spring, Far West Laboratory dropped to seventh place. Although the. 
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amount;of adult praise decreased, Far West's overall riieah placed In the third ' 
quartlle of the NPV standard, that Is, Far West classrooms exhibited more adult 
praise than 50 percent of all regular HS classroonis// It appears t^iiit Far Weaii 
Laboratory may have encountered difficulty, more in one site perhaps than in 
others, In Implementing this element, of their program. Possibly teachers with 
oxperience in v/ocklng with young children resist changing their commujilcatloh.. 
pj^tterns in this respect. V ^ - a * ' 

Factors- "As indicated In Figure 8, the most dramatic site differences' 
in Fa^ West Laboratory occur on Factors 2 (Individual children in a wide variety 
of ^ictfVItles) artd 5 (Negative behavior). Factor 2 s^ems moM relevant to the 
FQ.V West Laboratory program; It describes, essentlalTy, an Open classroom 
where many activities occur, where children work independently in small num- 
bers or with adults (One or two children or small groups), this seems congriiept 
with the Far VVest Laboratory curriculum, but the three sites show striking dif- 
ferences In their factor SQOjrps In the fall, and Site 13/i8 still aberrant In the 
spflrig. the three site^ also show very marked differences oif Factor 5 (Ne^r 
atlve behavior) fall and spring, although ^he spring range Is Somewhat smaller. 
Site 13 scored much above average in the fall and somewhat below average in the 
spring, It Is possible that this is due to an observer effect, si ^ce the observer 
in the fall was replaced in the spring, ; 

University of Arizona ^ ^ 

Variables -- The most significant site difference in the University of 
Arizona program (Table J3) fs .on Variable 59 (All child 'self-Instruction). The 
meaningfulness of thls^flnding, however, is mitigated by the fact that there is 
anecdotal evidence ^f;ConsIderable observer anrellablllty entering into this vari- 
able, due in part to a change In the definition of the relevant codes from fall to 
spring, '■ , ^ ■. . . * :y ^ ^ • " ' ' " • 

Although adults engage In activities wUh small groups of children in 
this model, they are expected to interact with the children individually. Vari- 
able 62 (Adult Interaction with one or two children) shows a Significant site effect 
in the fall but In the sprlng Site 16^s inean drops and there is no significant dif- 
ference between the two sites. By thte site-to-site consistency standard of Im- 
plementatIon» Vk progressed on this dimension during the school year 1970-71. 
Compared with the non-sponsored classrooms scale, UA overall ranks only in 
the third quartlle pf the NPV standard on Variable 62. However, it is possible 
that individual attention is a common enough preschool characteristic that to 
expect a sponsor to exceed 75 percent of all comparison (classrooms is 
unrealistic. • . 

Factors- -The largest difference betwe^ the two UA sites on the seven 
factors is on Factor ''Adult with large group" (se(^ Figure 9). The Arizona 
model expects adults to work with small groups, Ittthe fall, Site 8 had a score 
of 0*64 and 5ite 16, -1.19, By the spring, though. Site $*s mean dropped to 
-0.2^, which Is more congruent with the model's expectations and more similar, 
to site 16 's score. 
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Factor 5 (Negative behavior) showed a considerable difference between 
the twQ sltcfs,' with Site 8 at 0.96 and Site 16 at -0.46, .A great deal of negative 
behavior l8 presamo^bly an undeslrod clas&robm trait* \By springy however, the 
two sltea sedni closer tog^thei* and both sc^ed below a^rage. V ^ 

■ * ' ' ' ■ 'f, ' ' 

Bank Street College 

yariabie$- -Variable$ 62 (Adult Interaction ^itb ono^r two children) and 
63 (A^ull interaction with a small group) are, of the variables Ih Table 14 with 
sigiUflcant site differences, among those most relevant to„the Bank-Street moxtel 7" 
The 9urrlc«lum;}& designed to Inplude both group activities a^d interaction with 
Individual attentiort, Both tHese variables (62 and 6 3)t show signlflcaht variability 
between the two sites in the fail,* with site variance on Variable 62 remaining 
significant in'the spring, although with a small t-statlstic* On both these vari- 
ables, the^rankpf Bank Street relative to ^he other jsponsors rose considerably 
from fair to spring (sciiS'rartge tests. Appendix E). The combination of improved 
slte-to-slte consistency, and a rc^latively higher frequency on Variable 63 in the 
spring Would indicate some better' Implementation of this desired classroom 
charactotistrc. Qn Variable 62, although the bverall mean frequency Improved, 
in the spring, Bank Street still showed, significant site-to-site variance. 

Variable 70 (Child inltlatIon>^lth other Qhlldren), another critical ^ 
able, shows site differences in both fall and spring. This variable suggests 
an environment In which, children are free to^ work together without adults. Jnter- 
bct{on among chlldrep in Bank Street classrooms should be rdatlvely high; thai^ y 
|s, it is a desired plassroom choi^acterlstlc. However, Bank iStreetJs spring 
overall mean ranks, in the second quartlle of the NPV classroom distribution and 
the two sites remained dlstflmilar in thl? characteristic throughout the yeai;'. , 

It.is difflcult^tQ know what is a desirable number of chlld-»lnitlated inter- 
actions in a jBank street prograltn. The upper limit of the second quartlle Is 
nearly four occurrences on the average of Variable 70 per, GOp (five min^ute 
observation |wriod)#'^ \ : . ' ^ 

The highest NPV mean is about ten occurrences of Variable 70 per COP* 
Perhaps in nop^sponsp^ed He^d Start classroo;ns, where few aides ate available 
and children, ^re engaged in play situations durlry^ a good part of the day, ten or 
more occur^rehces COP would not be uftreasohable to expect. But the Bank ■ 
Street model Vouid ho^ be expectMtp ekd'eed such a f)rogram on bhlld-to-chlld 
Interactions, so perhaps four occurrences per COP is reasonable* The only 
thing that makes this doubtful Is that the University oTOregon classrooms, where 
, structured lessons involve teachers and chlidreyn in small groups, also fall In the 
' second quartlle, or between two and four childJto-child interactions per COP- ~~ 

Factors- - On factor scores'. Bank Sti*eet's two sites seemed closer on 
all faclors'ln the spring except Factor 6, "Positive behavior" (see Figure 10). 
In this case, the two sites differ even more Ip the spring than l2\ the fall. To 
attain a higher than* average (above iero) scorW a sponsor would have to have / 
• hlgh enoMgh firequencles on "Childj^sltlye behavior" (.Variable 68) and "All / 
' positive behavior" (Variable 82) to offset frequencies on the variables loading/ 
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neg£itlvely okthilt facjor- Var^abTd 0^ (Chljd asking adults questions), Variable 
48 (Child Initiates Interaction with adult),4nd Variable 70 (Child initiates Inter- 
action with children). > : 

University of Oregon v , 

Varla01es --The variables listed on Table 15 provide nultn ft onmprflh^n. 
sive picture of the basic structure of learning activities and'iliit^ractions In the 
University of Oregon program, Entphasls Is placed on the development of basic 
apademlc or pre-aoademic skills (Variable 11) In small groups (Variable 21). 
The Interaction pattern has adults interacting with the whole small groiiii much of 
the time (Variable 63), asking questions and giving feedback for vajiawe^s (Vari- 
ables 46, 47, ;48,* 52, and 54). Wowver, on only one of these orlti^cal variables, 
Variable 46, are the UO sites not significantly different both fall and Spring. 

- . FactorS '-The three UO sites shoW considerable variation oh several 
the factors (see Figure 11). However, on Factor l.( Programmed academic // 
instruction), the one factor most relevant to the model, the three sites not only 
attain high positive scores but are more consistent than on almost all the omr 
factors. Factdr 7 (Adult with large group), *shows less site-to-site corisist^iicyT- 
but the negative oi* vdry low positive scores seem congruent with UO's sm^ll group 
Instructional em.phaslis. 




University of Kansas ' / 

: -■ ^ — ■ • ^ ■ . J . ■ 

Variables - -None of the variables In Table 16 Is free from significant 
site differences both fall and spring.' The variables most crucial to t^O Unlver-' 
.alty of Kansas model, a behavior modification approach basdd on plentiful -and 
Immediate reinforcement (coded. Adult praise), are Variables 48 (Adult direct 
reqiiest followed by child response followed by adulttpralse) and Variable 512 
(Adult praise to cJhIld). The UK model also emphasises small group/Instruction 
in which the adult asks, questions of? individuals and reinforces their correct ; . 
responses. Thus both these variables seem to t^p critical model d^fobesses a^^^ 
yet the three sites show significant variation fall and spring, although the dif- 
ferences are somewhat less significant in the spring. The overall means for • 
these desired variables also dropped somewhat, although in the s(prlng UK still \ 
ranks in the third and fourth quartlles on Variablep 48 and 52, r^ 
conipated With all NPV classrooms. ■ / 

Factors — The three UK sites showed somewhat more /variation on 
Factor 1 (Programmed academic instruction), than might be expected for this 
model (see Figure 12). Again, the differences among sites ate more pro- . , 
nouhced in the spring. The kinds of interactions and activities which. comprise 
the progranime,d academic factor are all characteristic of the UK program— - 
such variables as "Activity C (math, reading), "Adult with small group In 
academic activities", "Adult praise to child response, " an^ (all) "Adult praise 
to child, "--weighed highly positlvr on this factor. Although there was slte-to- 
slte Inconsistency, UK's high scores on, Factor 1 are consistent with program 
objectives. . 
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nigh/fecope 

Varlables- -In alt but one Instance injTiible 17, HIgb/Scope showa sig- 
nificant sitTHlTFerences^ each of the selected varlaljles, While this set of - 
variables, unlike those chosen for some sponsors, cannot serve as a picture of \ 
the classroom, these variables should reflect Important aspects of the Hlghj/Scope ^ 
Head Start classroom. For Instance, in each Massi^^om, activity corners 6r^ .^ . 
centers are set up, probably Ih&ludlhg a playhouse or kitchen for dramatic plij^, 
a blockS'-and-trucks area, an art corner, and a/'qulet" corner wJKerfe table games ^ 
and puzzles are used. During much of the day all of these are being used, and 
there should be many other actlvltiep during the day as welK Variable 25 (Inde- r 
pendant ehlld activity) should reflect this aspect of the program, • Althbugh H/S 
shows a respectable third quartile rank on Variable 25 In the spring, there Is a 
significant site effect^ ^ 

Factors ^-Among others, the three illgh/Scope sltes shoyv (Figure 13) 
considerable variation ort Factor 6 (Positive behavior), Factor 6 Is not, as 
mentioned above/ a dimension whose other pole is negative behavior^ A rtegatjve 
score on Factor 6 means that the frequencies pn.posltlve behavior have been offset 
by higher frequencies on *'Chlld asking adult questions'* (Varlstble 60) and '^Chlld 
initiates lnti3ractlon with aduU'' (G9) and with o*heV qhU ' ^ 

Education Development Center ^ - / , « • ■ 

r Variables- - Of the variables listed In/r&bie 18, i*^arlables 24 (Vi^Ide ' 

' variety of activities), 25 (Independent child activities)^, and 81 (All motion) seem 
. most crltlcaTto the Education Development Qe^^ The open classrooms 

of this model foster a wide choice of learrjfpg activities In which children are 
encouraged to work independently of adults< Children are allowed to move freely 
, about the classroom and adults n)ove among actjivltles glvlr\g children Individual 
attention. On Variable 25"^ndependent child activities), the three sites ended 
the yearh^lthout significant site variance, and EDO's overall spring mean bn 
Variable 25, compared to all NPV classrooms, ranks. in the third quartile. 



On the bther two variables, however, 24 and 81, there are Significant 
site effects b(>th fall and spring, although the NPV quartile rank of the spring 
mean frequencies on these variables were three and four respectively. 

Factors —Factor 2 (Individual children in a w|de variety of activities), 
^ggests an opeh classroom similar to that encouraged by EDO (see Figure 14) • 
The three sites, however, show considerable differences on Factor 2, especially 
in the fait. Another factor. Factor 7, (Adult With large group), shows striking 
site differences, due primarily to Site 8, both In the fall and In the spring, 

Fall-to-Sprlng Sponsor Differences 

While fall-torspring consistency Is not In itself an indicator of program 
Implementation, It is of Intefest-ln conjunction with the two Implementation 
criteria revealed in the previous two analyses, l,e,V consistency between 
desired classroom processes and observed classroom processes, and consis- 
tency across a sponsor's sites. , i 



u 
a 



0 

P4 *^ 



CO 



H 



CO 



O 



o 



« 



o 



H 



!2 



O O 



CO 



00 c? 



<0 -rt. 



(0. 



4^ 



0 

P4 



•H H I 



(0 



CO 



CO 



CO 



CO 



CO 



ID 
o 



• o 
o 



.3022 




-.8 . 








:^ 


§ .■ 


-co; 




00 . 

o 






a 

^«) 




H 
O 


O ^ 
00 


C 
H 


• < 


- 






O 
H 














■ • 


8 


I' 


in: 


N 





o 



H 



0 



0 
0 

d 

0 



0 



/■ 



>4 13 



13 2; 



\ 



71 



(3 

O 



d 
0 

c > 



> 

■H 

0 

o M / 

•O H 

d x{ 



3 cr 
•o. 

< ^1 



in . 



d 



3 



0 V 



CO 



. o 

. .H 



00 



00 
H 

53 



SPONSOR HS 



, 3 60 
MO 

.3.00 

bio 

2.40 
2.20 
2.00 



1.dO 
t.60 
1.40 
1.20 

i.oo 

0^0 
0.60 
0.40 

: 0 . 20. 

-0.20 
"0.40 
-060 
-O.W 
/^l Op 
-1.20 
r1.4b 
-t.60 
*1.$0 



FACTOft 1 



SITS 



2 6 10 




pAcron 2 



Site 



2 e 10 



IF 



f ApTOft 3 



sitr 



2 6 10 



i 



MCTOft 4 



SIT6 



2 6 10 



FACTOR 8 



SITE 



2 6 10 




pACTOft e 



SITE 



2 6 10 



Site 



2 6 10 



FIGUftE t3 HIGH SC6"PE— FACTORS SUMMARY 



ERIC 



72 



u 
0 

H 

u 

W 



0 

0ei 



^1 



01 ■ 
CO 



0 , 



»; 


lO 

o 
















1 






• 




a 








• 


H 
















• 


H 












CO 




.. H 
















H 










O 
















H 


O 






O. 
■ 




8 



10 



• ■ 

8 



CO 



10 



■irt 



I 

CO 



iO 
0^ 



8 



CO 
10 



(0 



W iO 
JB O 



CO 



CO 



00 ^0 



lO 

o 



CO 








CO 


CO 


8 












10 




^ > lO 






10 


00 
















H 






O 










CO 


CO 


10 












H 






CO 






















■ 

CO 






v^ 




o 






o 


lo' 








t3- 





00- 
r-t 



0 



CO 



^0 " 
CO 



iO 



^0 



00 



10 
^0 



0^ 



00 
*0 



00 
0^ 



o 



o 



10 

o 



lO 








' » 










o 

10 


H 




i-l 




^ ■ 









CO 

o 



00 



0^ 

I 

00 



>4S 

CO 



o 



(A 

■ ^1 * 

I " 
ii 

O (S 

u 

> <9 

a 
< (4 



& 

H 

t 

,a 

CI 



o 
> 



> 



*0 

o 



4> 

a 

6 



I 

0 

•H 

o 



10 



■ d 



0 

d > 

g 

1-4 H 

;d o 



d 



0 
0 



d 

0 

-H 

0 



- 0 
M u 

AH 

§ 3 

O 0 



(0 



o 



H 



H 

00 



eric; 



1 ' 

! . 



\ SPONSOR ED 



3.eo 

3.}0 
fOO 
2.80 

2,eo 

2,40 

2.20 
2.00 



hsa 

'1.60 
1 40 
1.20 
» 100 
^ 0.80 
060 
0.40 
0.20 
0 

-0.20 
•0.40 
-0.80 
-0.80 
.1.00 
-1 20 
•1.40 

•teo 

-1.80 



MOTOR 1 



SIT6 



$ 6 8 



1 



J 



FACTOR 2 



SITf 



5 6 8 



tr 



FACTOB 3 



Sire 



6 6 8 




FACTOR 4 



SITE 



8 6 8 




FApTOR 6 



Sire 



6 6 8 



i 



FACTOR e 



SITE 



& 6 8 



FACTOR 7 



SiTE 



6 6 8 



I 



FIGU.RE 14 EDUCATION DEVELOPMENT CENTER EDC— FACTORS SUMMARY 



74 



To be considered Iniplemontcd, a sponsor must.demonstrate that his meth- 
pdologlcal objectives are Indeed realized in the class^^^om thAt Is, that obser- 
vatlonis of classrooms reveal that teachers ih all sttes^^xhlblt the model's Importahf 
classrpbnx behaviors similarly, In addition, ;program cnaracterlstics that*dre 
value dre tho. ability to Sustain a high degree df^hiijilei^ientaUori froniJaU to spring 
or, having began the year unlmplementcd/ progressTpl^^ the sponsor^s ^oats. 

Some degree of shift Is to be expected mpre perhaps in some sponsors than 
in others -- as children and teachors aCdustom themselves to each other ahd to 
the classroom environment. Head Start children aye usually bx^^ \ 
school situation for the first tinje and there must be liiany inevitable adjustments 
to the den1ands,of a new schedule and a^ set of new behavior standards. : 

Barrihg these adjustments, one would expect a sponsor^s program to remain 
;consfant Jn\those characteristics mos central to his educational design for children. 
For^ Irtsfanc^^ In many programs adul|s may find themselves spending less time' v 
'co?^ctIrtg children's behavior as children learA and adopt the xules of the class- 
rpoirT^-Yet the methods of Instruction .or other crucial eleriients will probably re- 
mialn relatively consistent at least in classrooms wh.ere teachers aye in full and 
.competent compUance with sppnsor bxpec^ ^ J 

^^^Qn^the otherJiaiid^-jalassroom/ which begin the j^e&r not Impiemdntlng sponsor 
intentions but which, In the spring, exhibit a greater consistency with model goals 
have shown that these teachers Kave become more proficient ih the mo^leL Another 
possibility to be considered is that, having' begun the year.-- perhaps fresh fr6m>-r 
preservlce teaching by presenting children wlth a well implemented mode\r/ 
teachers, as the year progresses, revert to previous teaching pr act ices, -^fn- 
corpdrate new non-spons^or Input, or develop. their own adaptation^, for other rea-^ ^ 

-sons. So, in the spring observations, it |s seen that these clciss^f^oms have re- 
gressed in terms of implementation. . 

A summary of faU-to-spring differences on variables and factors follows for 
each sponsor. Appendix F displays fal^-to-spring differences by site within spon- ^ 
sor,on the tofal variable list. The selected sets of implementation variables, have 
beei^ extracted from Appendix F and are reproduced for each sponsor In Table 19 
with the results of a t-tost for significance of difference between fall and spring. 
Factor scores for each sponisor^^ere displayed in Figures 8 through 14. 

Far VVest I.aborator y _ : 

Variables --Only four 8ignlficant'(p<.05> changes were discovered 
between fall arid spring observations at three sj^s ovef ten variables (30 com.- 
parlsons). Three of these changes showed a decrease In frequency on desirable 
variables, while the other represented an Increase In^he frequency of a desired 
class roohi behavior. ^. , 

Factors-- Fall-tb-spring differences are minimal at all sites in this . V 
model. In fact, only on Factors 5 and 6 at Sites 5 and 13 are the differences 
noteworthy. Site 5 shows an Increase in negative and positive behavior, .while 
Site 13 shbws a dramatic decrease in scores on both these factors. Since the 



\ 



s 



0 e / 

• • ♦ 



iS q S 8 R S 9 x » 

, . ,M ^ W N #1 H 

t; R s ;3 s 8 S S ' 
.«,•**• • • I • • I 



• I • • • $ t • a . $ ^ 
« H « 



* • ^ « • • • • • 



-'irSP i5 ? 9S8 88 



. -H *1 4 ♦* 

.HI ill 

• • * ♦ . •' 



M H H N 



' » » ^ ~ •\ t • • « • 

M H ^ * « « 1^ 



»8$8S{8S?!;88 



{i 8 s is s s a s ^ s 



i: S 8 $ 9 !^ S ^ S 

H M H H M <0 

H M H •\j JJ H O 



i 

■ p 

i 



I 




« 6 d 



5 ' 



Pin ^4 

1 51 HI ill I 



78 



V 



I 



SSI « M 



# • » 

H ^a H H 



Si S5L?I S S .S 5 8 



S g 9 8 ?^ 5 8 



« H 



H N 



H H 



s 8 a a 2 s lo 'S 

^ ■ ■ H ; 



o 

H 



^ 00 c4 

M CM in 



CO 



5r< 4n 



o o 



<0 N 



.8 8 

• t 

H 



I/) 100 



,00 



H 



00 
CO 



<h 



H 



■ X. 

H H <^ 0> H m 
CO o o V w 55 



CO 



H H 



0) ift: 



S? 5$ o H 8 ^ 

• • < . • • • 

cj H ;h o 



O 



CO 



So 



O 

■ « 



S 8 I S 

* I f « • « 

CO CM C^ H ^ 



2 ^ m N ,00 00 

CM CM CO . . ^ 



^ § 8 s 8 



<7> 

0) % 



•I 



i 




<jO CM 

C4 CM C^} ^ (0 



77 




4 S. 8-8. a S 8 8 8 M 



8 

2.8 8 



:i\ fi SIS 



H .'M H 



in 




N M N 



♦ • ' • • • 



5 



S2 $ S2 8 



S ^ 8 9; ?! 8 8 

W WW, 



S S &fi888 

f f • < • « • 

w M i-t ^) H i-t tf) 

','/'■ ■ 

• t . • f • t f 

H w r:^nnw|^ 



/ . • * f • • 



>> M « 2 ^ 



,' W / . ■ H ^ M M H% 



0\ e j2 



• • * . ■ 9 

8.8.16 8 



(J 8 ii'SSS 



8 S;-S 3! S 

• If** 

n w ^ N 

• ■ -/ 

H <i W 



^ » S 3 S 



p\ iT I S g S 



3 



H »; S» 

WON 



R 8 8 



- • • « f I 
10 W 



/ * 



/I « 21 iff: - /M 



1/ 

'8^ ic 



7 



II nil 




.Is 




, nil 

5^9. 3 8 X 8 



i 



|7! 
11 nil I 

• ■ • • ^ • , • 



9d 



I 



00 



$ s o ^ s> o 



•/ • • • • .# • • 



• * • * ■ • • 4 « 

. H CO ^ M 



I 



I 



^ $ lo UO 8 o S 

« • I t • « 

H CM CI 



Q CO O <f N 10 
O UO O 9) C>M "tf* 

H CO <0 





1 


a 
♦J 


1 ^ 
1 ^ 


■ » 


H 


(0 




1 H 




TO* 


. Pltl 






• •'^ • • 
H CO N 
, H 






w 






H 


H 
H 


* 


10 00 ^ N 
^ CM 5}« 10 






5! 




« « « « 





Far West model aUow^ freedom fbr a^wlde range oi enliptloi^al behavfor, any\ 
level, or any changes lnr level, would bo In keeping with the model. 

' ' ' . ■■ /■ ■ ' , • ■ V ■ ' ■ ' .'■ ' ■' ' . . \ 

Unlverglty of Arizona 

/ VariabloS' ^-At two sites over 11 variables (22 comparisons), the class- \ 
ropm frequency of five variables changed significantly between the fall atid spring ' 
observations, 0f these, four changed In the direction of greater consistency with 
sponsor objectives^ and only bne reflected a decrease In a desired characteristic. 

'/ ■ , ■ ■ ' . . ■ ■ ' • ' ,/ ■ V • i . . ' , ■ ■ 

/ Factors—of scores on 3even factors measured at two slte^, thefe are 
only two noteworthy fallrto-sprlnfg differences in this model. . Site 8 shows a sub- 
stantial decrease In Us score on Factor 4, (Choice request Interactlom, and on 
l-'actor 7, (Adults with large groups). Since the choice request or ope^ji-ended 
f^uestion/ls fairly Important to the UA model, It may be Inferred that this aspect 
,bf the program was lew well Implemeh^ed at the time, of the sprlng/observatlon. 
/The decrease In^large group activity may be considered as b(;lijg iwix pcdlilvo 
/direction, ' ' 

Bank Street . . 

Variables -- At two sites over ten variabfes (20 comparisons) this model 
. had declined significantly in frequency In the spring on only one desired variable, 
'•Adult child request. /V V ^ 

Factors— -Several fall-to- spring changes occurred on factor scores at 
sites within this model. Both Sites 1 and 12 changed dramatically on Factors 2, 
5, and 6. Dank Street also permits a wide range of emotional behavior; so chang^es 
on Factors 5 and 6 are not critical. However, on Factor 2, (VVjde variety of^^ 
activities), the changes at both sites ar? substantial Increasesr^nd represerit ™ 
better Implementation in a mpdel ihat advocates experlenClal variety Irt Its 
classrooms. ^. 

University of Oregon , / v 

^ — ' ' ■■" ' v ■ ^ ' ; ■ * • • ' ^ . 

Varlable8- -*At two sites over ten variables (20 compaHsons), numerous 
changes were noted In f^U-sprlng variable frequencies wltl)lh this model. At site 
11, the moan frequency of seVen variables changed slgnljfl6antly. Six Were In the 
direction of more positive Implementation of the spbhefOlp's goals. That is, the 
frequencies increased on ^ix variables that should oc^ur at high rates and de-* 
creased on only one. At Site 14, the frequency of three of the ten desired varl- ^ 
abl OS, depr eased between the fall and spring observations. 

Factor^ --Thls model shows a high degree of consistency between fall \ 
and spring moasuroments over the seven factors. Only two i^otable exceptions > 
appear. Site IMncrease;! Us spring score on Factor 3 (Adult feedback to children) 
by approximately^ three^ times the st&ridar^lzed^v^ Its fall score. Since this 
feedback factor fits the stlmulus/jresponse/roinforcement paradigm important to 
the model, thcr change may be considered as In the direction of better Implementia- 
tion. Site 14 i9hows a considerable decrease In Its spring score on Factor 4 

■ e ' • ." ■ ■ - ^ ' * . • ' • ■ 

'. ' ' ■ ■ . ' - ' ^ ' ' 

, .' ■ " "81 
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(Cholcfe request Interactions). Since the variables loading heavily on this factor . 
are dtilmportant to the Oregon modol> th6 change may be regarded as neutral. 

' University of Kansas ' - Y 

V,arlabl68 --Con8lderlng penformance on ten variables at threie^ sites (30 
comparisons) within this model, relatively few fall-tp-sprlng changes are noted. 
Site 2 chariged significantly on only one variable, and that was In the positive V 
direction, I.e.i an Inoifease In a desirable charactdrlstid. Site 4 shows no 
significant differences between the two observations. Site 8 differed significantly 
on half of the criterion vattables between the (&\{ and spring observations and 
three of these represented decreases in desirable characteristics * 



V r Factors- - Fall and spring factor scores were obtained for, this model at 
three si^es on seven factors/ Of the 21. resultant. cpmparl^sons within the model, 
only one site recorded a i3ubstantlal\change on one^iaotor;' Site 8 shows an in^ 
crease in '^Negative behavior^' in the spring. In |His model negative behayipr by 
adults should be/mlnlmal and, while not actively suppressed in children, Jt should 
be extinguished through the process of non^relnforcement. Because of the targe 
variety ;of variables loading heavily on this factorj the Increase may or may not 
represent a decrease In model Implemontat^bn at thla^slte. Overall, the consis- 
tency of scores between the two measurements is high* 

iflgh/ Scope ' " 

' Varrables- -\Vlth the necessary exclusion of variables related to the ' 
relative use of symbols and objects in academic activities, tho drlterion. vari- 
ables set for this model are consldet'abiy we^kened.x The fall-spring comparisons 
are jnade on only five varlabjjs^serv^^^^^ three slt0s within the program :_ 
(is comparisons). Four significant differences are n^ted between variable fre- 
quencies on the fall and spring observatldns; tVvo W0fe ih^tho direction of Increased 
implementation of the ^lodeld' goals, and two represented^decreased iji*equencies 
on desired prpcesses. " r ^ 1 \^ ^ 

^ Factors-.- Fall and spring scores were, obtained for tf\C a^^ 

three sites within this model; Several changes are i)otewortiiy between the two . ^ 
observations. On Factor/1, (Prbgrammod academic^ Instructloi^. Site 2 sfiowa a 
targe decrease in the spring score and Site 10 showsva large Increase. Still, ' 
scores for all three sites on both observations remalh below the mean on this 
faetor, ^nd that Is In keeping with the model. On Factor 2, (Wide variety of 
acttvltli3S), Site 6 increased its ^cord in the spring while Site 10 decreased* For 
this model, the Increase to a positive score on the factor Is probabty more in 
keeping with the ihtefided goals. Two sites show lacge decreases in scores on 
Factor 3 in the spring. Since the response-feedback i)arQdtgm Is not central td 
this model, the changes may be regarded ae neutral. Changes noted on F^c{U)rs 
4 and 5 are likewise unimportant to this sponsor's goats, aind in fact It may 
that variables important tb tills model fail to load on a^;y single factor t)ut spre^ 
themselves lightly across all factors; Factor scores ^eem partlcutariy Inappro^ 
priate to measurement of Implementation of the Hlgh/I^ope program/ 



Education Development Centor 

■■■ ■ -' y.. - y. — : . ^ ■ ■ ■■■■ ■ ■ • . : .. ■ 

Variables- - Considering olgKt criterion variables measured at two sites 
within this niodel on the fall and sprIng*observatl()ns/ only two significant changes 
resulted from the 16 comparisons,' , One is, however, a Qbangi? of such magnitude , 
that It bear^ closer examlnatioiir Variable 20 (Child Initiatln^Un Interaction with 
another child), vdropp^d from an approximate rate of 6,2 times per COP on the fall' 
observation* to 0.7 times per COP oq the spring observation in one site, Such a 
change becomes reasonable only when considered In light of the fact that Variable 
69, (Child initiating Interacilons with adults),' showed a coVrespondlng fall-to- 
spring increase at the same site, Although it is desirable in the model that both 
behaviors ocour'at a high rate, it may ijot be possible'for both to occur at the 
same time, It is likely th^t iat the time of the spring observations, classroor|is 
at that site were engaiged In activities that involved adult/child interplay to a far 
greater degree than child/child interplay,^ Both are In keeping with the flexible 
nature of EDG classrooms. 

Factors --- Fall and spring facfor scores were obtained at three sites 
within this model, and the differences among sites are noticeably greater than 
any fall-spring changes within, sites. On Factor 2, (Wide variety of activities), v 
Site 5 decreased gi^e^tly in its spring scoi^e while Site 6 increased^ put stlU 
remained below the standardized mean, :*$lnce, of the seven factory, tHisl^ the 
one most descriptive of the EDC program, these scores ar^ somewhat Inconsis- 
tent with sponsor goals, On'Factor 4, (Choice request interaction), Site 5 de- 
creased noticeably in its spring score while Site 6 increased, .Changes on Factors 
5, 6, and 7 are^not considered t*elevant to implementation of this sponsor's pro- 

s^^^' < ■ ■ ■ / ;* ' -.^.^ 

CJnlvergity^Qf Pittsburgh ^ 

Varlables --Only one site was observed for this model. Of six variables 
considered important to the model; f^l-to-spring differences weto recorded on 
three, each representing an increase; In the frequency of a'deslred characteristic. 



, • Factors-^ Secures on two factors are substantially different between the 
* fail and spring obsbrvatl^ons. On Factor 2, (Wide variety of activities), UP 
increased fronv0,8 (already high) to 2.74, and on Factor 4, (Choice t^equest 
interaction), from -0,36 to 1;7, Variables Andlpattng Individualized instruction 
load heavily on Factor 2, ^o an incr^ksed score on tl;iis factor Is indicative of; 
progression toward implemerttatlon/ , . 

Responsive Environment Corporation ^ ^ 

Variables — Fall and spring observations were made at only one site 
within this mod^I, Over the six criterion varlableis, no significant difference? 
in frequency were^ noted in the fall/spring comparison, , 

^ factors- -No noteworthy changes occurred on any factor scores at'the 

Single site observed In this modeU - \ 
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Relatl6n of Implemehtatlon to Test Outcome * ' 

— "-^^^ — — ^ — ^t— — ' ■ / ; ...^ V' ' : — - : 

Contrast of the^Effectg of Well Implemented and Less Well Implemented 

\ / ' Classrooms ^ t-v^' • 

. •— — . A: ^ * 

One of the questions rais6d In the introduction Is the apparent fack of 
"striking'^ effects of preschookprogramgV pne augges^^ U that 

failure to fully implemor^t programs mitigates their ou^^^^ In order — 

to clarify this, tl^e analysis Investigated the relationship bot^veeh th 
implementation and test results; that Is, the hypothepls that the higher the.level 
V. of prpgram Imple.meriteition, th6 higher the t^st 8^^^ 

this Is done by contrasting the test outcomes of well Implemented classrooms 
with those.of less well implemented classrooms. ''To avoid confounding the results 
wllh differential model effects on tests, this contrast was conducted wlth(n sp<>n- ] 
\ . ; jBpr. the contrast is first made using raw change scores, then reteste<Vu8lng 
:\ ; adjiisted spring scpres. 

■ " " ■■ ' .[ \' \ ■ ' ' ' ■* ■ , i' . ' ■ :-" 

; Contrast Uging Raw Change Scores . , 

? The quartlle rank standard derived from the comparison datp washed 

to measure the level of Implemehtatlon in all PV classrooms on thfr'basls of 
spiring observation data » A percentage implementation score was calculated for 
each classroomi as described in Chapter 11, and classrooms were^ ranked wUhln 
sponsor by this percentage score/ the classrooms with the hlghe*st and Ipwest 
implementation scores were then identified for each sponsor/ High and lq,w im- 
plementation in this case, then, are relative designations (i^e. , high and low 
relative to one another under a Single sponsor's auspices). Table 20 shows the 
number of classrooms In each group for each sponsor, and each group^s mean , , 
\implementat}on score (expressed as a percentage). 

\ the change *e CO res for these two grpups, those with high implementation 
scares and those with low ones, were contrasted within siFK)nsor. For example, 
the Nnean change scores on the four outcome measures of the four Fdr West ) ' 
classrooms with high Implementatlpn was contrasted with the mean chatige flpore 
of the four Far West classropms with Ipwer implempntatlpn scores, table 21 
shows the significance level of these contrasts ifor each sponsor. 
• . ' y ■ - ^ ' , ' ' ■ ;.' •.. ' -■ ' ' 

the assumption that better Implementation la positively related to 
higher test scores does not appear to be upheld, Looking at Table 21, |t Is 
. apparent that the jev6l of implementation, at least as measured here, does not 
bear much relation to test outcomes. In all but two pases, there Is no significant 
difference between the mean change scorbs of the highly Implemented class'rooms 
and the low [mplemehtation classrooms. ' 

t ■■■ ^ . ' ' , ■ , ■■ • ■ " ■ . . ' 

The four Bank Street classrooms with ^'hlgh'^ implementation scores 
achieved a significantly higher PSI (Preschool Inventory) change score than the 
three ^low" Implementation classroomSi The reaspn for this is unclear. 
Although it ma3| be convincingly argued that this is Indeed an ^ 



Table 20. 1 . 

"HIGH" AND "LOW" IMPLEMENTATION CLASsiiOOMS BY SPONSOR 



FW UA BO ' UO UK HS '■' ED 



Total Classrooms* 


8' 


8 


7 


8 




12.: 




^ Number Classrooms In 
High Group ^ 


■ 4 


.': 5'. 


4 


■5 


3' 


^ ■ 4; , 


4.. 


Mean Implementation 
Score, Percent ; 


'73. 


" 78- 


83 


93 


97 


77 


77 


f NTumber Classrooms in, 
■ Low Group 




• 3 ■ 


3. 


3 


A 


4- 


4 


Mean Implementation 
Score, Percent 


65 


70 


' 65 ' 


87 


79' 


60 ' 


61. 



♦With spring observatloh data arid fair and spring test scores available. 



, » - Table 21' , ./ ■ v., .. : 

' CHANGE SCORE CONTRASTS: • 
"HIGH" AND ''LOW" IMPLEMENTATION CLASSROOMS BY SPONSOR 



F\V UA BC UO UK HS ED 

NYU Booklet 3D * NS NS NS NS NS- NS NS 

NYU Booklet 4A ~ ' "■liS~""'m~''- NS NS' NS NS NS 

Pre-school Inventor^ NS NS <.02* NS NS <,02^ NS 

Stanford Blhet 7 * NS NS; * NS NS 



♦Positive relationship: high Implemeritatlon classrooms 
achieved higher mean^hange score on test. 

'+ Negative relationship; low Implementation classrooms 
a'chleVed higher mean change score on test. ' 

tscores not available for all classrdSms; 
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successful program implementation, since the PSI Isi of the four tests, the pne 
most likely to be sensitive to the cognitive growth currlcula,Vthls effect 4s con- 
founded with the possible site effect. The four '^hlghly"'lmplementi9d classrooms 
are all In Site if aimj the three /'low^'/lmpletnentatipn classrooms are all In Site 12,^ 

The PSI would seem to bo the test most relevaht to |he Plagetlan High/ 
Scopd model also. In this case, hpwevert the group of classrboms' achieving a 
significantly higher mean change score on the PSI is the -group \vlth lower im- 
plemeiitatlon scbrps;, This may be due/ at least In part, to the fact that Site 2, 
one of the sites Contributing half pf the 'low'' implemehtatlbh classrpoms, achieved 
very' large gains in the PSI (see Table 22). The rh'ean change score In Site 2 is , 
20,^8 polntsi that*bf the other two H/S sites, 2,07 points and 12,7 points. Pre- 
and post- scores for Si,te 2 ai:'e both lower than those of the other High/Scope sites* 



\ '. . / Table 22 

^ HIGK/SGOPE PSI TEST S^^ 

/ Mean Mean ] / 

V V : Pre-test'. post-test ' • . Mean Gain 

\ . ■^ " :'7 — ! — — ; . 

\ site 2 ' ' ; 23.72 . 40.72 V 20,38 

; < SI to 6 • ; 40.45' - 42.53 ' 2.07 . 

Site 10 . , 40.43 53.12 12.70 . 

The 'low" Implementation group includes two Site 2 and two Site Ip classrooms; 
the ^'highly'' implemented^ group, three Site 6 classrooms and one SI t^ 10 classroom. 

It may be that, although rated ^low'' by this estimate o( degree of Im 
plementation, teachers in this site did utilize the sponsor's progi^am sufficiently 
to produce great gains In the thfe cognitive test scores, of children who began the 
year with very low PSI scopes, Oh the othei^ hand, this gain may slrtiply repre- 
sent the effect an enriched preschool environment, regardless of Implementation, 
can have oh chlldrprt w^ • " V 

Coritrast Usjug Adjus^^ Scores > ' V ' 

• The^ame^roups of cljfl^ssrooms were contrasted using post-test scores 
of three outcome measures (NYO 3-D and 4-A, and PSI) as adjusted by demo- 
graphic and prescore covarlabl^s*, MODEL V of the regression analyses con- 
trasted, within sponsor, classrooms with high impleonentatlon scores and those 
with lower Implementation scores so as to check the results of the preliminary . 
analysis above. ' V . , 



♦The relationships of the covariablcjsls discussed In the next analysis, 



Fqllowtrtg are tlje relevant hypotheses tested,* stated In the form of 
the null hypothesis with the significance levels of rejection shown. 

Hypothesis — That the (ilgh/low Implementation contrasts as a unitary 
set have no effect on the test results as a unitary set, 

• - - 47 class rooms . \ 

df = 24/79 . ■ • ■ . 

F = 1.36 ; ' ■ ,. V 

■ ■ ' " ■ . ■ . " p < •o.s ■ ' , , ■ ■ 

l Hyp6thes[S" ~That the high/low Implementation contr^Stp considered 
; * separately have no effect on the.test results as a unitary set, 

N = 47 classrooms 
■■ df = 3/27 



Contrasts 




P 


!• University of Arizona • 


0.-41 




2, {jntverstty o| Arizona' . 


0.86 




3. \ High/Scope ' 


5.15 


.05 


4» Unlver$rty of Kansas ^ 


0.14 


. . NS ;• 


6. Far West / 


1.7 


■/m . 


6. EDC 


1.4 


NS 


7,, University of Oregon 


0.7 


NS 


8. Bank Street. . 


. 2.15 


NS ; 



The results of this analysis indicate that the contrasts between high 
arid low levels of Irhplen)ontatlon within sponjsot' l^ave an overall effect oh th$ 
three adjusted test outcon^e as 4 unit (p<.05)» koweyer, when each f ponsor^s 
contrast Is regriBssed on the butcomesr, as a uftlti only one sporilsor's cohtr$$t 
(Hljgh/^cope) Is significant i(p<;05)y The resuUs of the hypothesis test o^^^ 
relatlons^jlp of each contrast to each outcome ihow that the H/S contrast Has, a 
significant (p<, 001) effect on the PSl. this replicates the earlier finding', 
when, using raw change scores ^ the H/S cl^jssroon^s with the l6\vest Itnplementa 
tlQn scores attained much higher PSl scores. ' 

— / • v'v: '.: '.^' ' ■ : - - 

♦In the write-up of these and other regression MODEIfi, not all hypotheses 
tested are discussed*: All the hypotheses tested jn each model appear in 
Appendlx.H* ; ^ 

'Two contrasts v^ete run for University of Arizona because of the (Jlstrtbutlpn 
of classroom Implementation scores In which several same and oontigUQUs 
values occurred. : , 



In general, howover^ the finding of the preliminary analysis that the 
level of tmplenientatton Is ftot strongly related to test results Is upheld by 
MODEL V. ^ : ^ 

There are several possible eKpl^natloiis for this. First, It Is, possible, 
thai the level of program Implementation does not^ In fact, bear any relationship 
to these outcomes, In all or biOst sponsors, that Is, that the treatments offered 
by the sponsors are not releyant to the outcome measures employed^ so that the 
test scq|es are unaffected by the l^ 

Another possibility Is that the liavel of iQiplementatloh of soi^O or tno^t 
sponsors^ entire treatment Is indeed relevant loathe outcomes but that th^ 
particular treatment components vsed to assjBss Implementation In this report' 
0. e, ,> classroom processes and behaviors) are not In thpmsolves rpl6v$nt^ This 
is tested In a subsequent analysis v/hlch examines the relationships oMhe Im- 
plementation variables to the outcomes. \ 

Yet another possibility \t that the level of ^implementation as ^neasuted 
by the selected variable sets Is. related to tost outcomes after allf but tha^t this 
relationship does not appear In this lanalysls^ because of the levels of Irnplementa- 
tlon pontrasted. For example, Table 20 shows* that the n)e|n iRiplemo Aation 
score of UO^s highly implemented classrooms Is' 93 pefqent and that mean of the 
less Implemented classrooms, against which these, are tested Is 87 percent, this 
difference Is less thaif six percentage points and, In fact, bo^h exceed tUe mean 
Imple'mentaflpn scoreis of most sponsor's '/high'* claiJsroomiS, !( 16 vei^yWsslble 
that this analysis shows no significant dlfferenpes lii test outcomes between these 
two groups of classrooms because theCdifference In level of Implementation Is sp 
sVnalU Significant dlfferiences might well be found In contrasting class rodmis 
between \vhlch there are more dramatic differences In implementation, fb some 
degree, th^s problem is pertinent to all the models contrasted In these two\analys 
relatlrtg level of Implementation to outcome. 



Regression Analyses 
MODEL i - fiffe^^^ 



of Demographic Coyariables on Test jgjli^ults / 



. V On a prelltnlnary run of MODEI^ J, test outcomes were regressed 
47 variables describing demogifapfilo chaTacterlstlcfi and pretest scores selebted 
from /Huroti's total list* MODEL I was designed to ascertain the* am 
ance In test resUlts accounted for by these varlalyiles, herein after referred to as 
covariabtes. Table 23 displays the effect of each of these 17 covarlables on the 
set of four outcome measures (NYU NYU 4-A,^PSi and Stanford Blribt)* 

^—--^After-the first-run of-MOf)ELs,I^ rtiade t 

rerun the regression MODELs deleting the Stanford Blnet, B.lnet scores wen 
^unavailable for so many classrooms that the classroom sample was seriously 
dtmlnlshed, "MODELS Were theii rerun without Stanford Blnet scores and also 
Without npn-contrlbutlhg covarlables so as to Increase the sample sl^e and the 



Table 23 
MODEL I ORIGINAL AND RERUN 
Seventeen Original Govfif lab les 



C ova r liable 



.2. 

6, 

7. 
. 8. 

?i 
10, 

12. 
13. 

15.. 

16. 

17. 



1. 

2; 



5. 
6. 
7. 
8, 
9. 



irodtti present both fall 



Nuthber chUdren in 01 
atid eprlng * . 

Mean age In months • ■ 

Percent female 

Percient having p^evlo^B preschool 

Percent having English as first language 

Percent non-white 

Meaii size of household 

Mean Income , 

Mean mother's education 

3-D total prer^icore 

4rA total pre-score • / ' 

PSI total pre-|Score ./ . ' V 

Stanford Blnet (Plnneau scoring) pretscoi^B 

)^6rcent read at honie , 

Number valid pre arid p-pst 3*D ' 

Nuipber valid pre and post i-A 

Number valid pre and post PSI 

. • List of l^lne Covarlables 











statistic 




1.67 




^ i4Vl4 




1*08 




• 3.82 


> 


■ 0. lo 




; 4.09 




1.41 




0.83 




4.49 




3.45/'' 




- ■ V'. 








/2/35^. 




/ M* ' 




0.65 




0.79 




i.77 



Mean age . In months * ^ 
Percent having prevloius prcjfictcM&l 
3» Percent having fingUph as ftrat language 
4, Percentj\OQ>\vhUe J: _ 



Mean mother*8 educatlonMn years 
Mean total 3-b pje-score , y 
Mean total 4-A prd^scbre 
Me^n total PSI pre-^core 
Number valid pre add post PSI ' 



89 



rp, 



L 



NS . 
. 001 
'NS- 
.01 
.05 
.01 

Ns;,/ 

Ns/ ■ 

.09 
NS \ ' 
.001 
.1 

NS • 
NS' 
NS 
NS 

/ 



f 



degrefes of free,^nv In significance tes"ts..* Nino covariables were retained as 
CqyarUbles for^ntl subsequent MODELS.* These are listed in the lower part of 
Table 23. Mean age, percent -preschool, percent having English as first language 
percent non-wljlte, level of mother's. education ^nd 3-D and PSI pre-scores had 
significant effects Jn MODEL I. They wpr^, retained, and In addition, the pre- 
.(esl Qcore oh the-otlvet' outcome hiQasufe used In the analyses (NYU 4-A) was 
fetatned.- Slnc^the PSI was the strongest predictor of outcoiiios, tiSe number of 
valid pre- and "p0st**^PSI tests per class wSs al§o retained. . I 

.Th? flUftstions asked of MOpEL I were: j How much variance in test out- 
cbmes^ls acopuritedlor by the nine povaiHablesV-Wd ftoNv-much Is left to be pos- 
sibly acc6unted;fov by the classroom process vaHables ? The-propbrtlon of 
variance accountbd fot^by the set of nine covariablels, ,as a unit, was: 



NYU 3-D 
NYU 4-A 
-PSI 



Percent Varlancd* 



0.66 

66 



^ Two-thiixis of the variability on the m'U 4-A and the, PSI are accounted 
for by these ni^n^ covariables; only one -third remains. Three-fourths of the, 
ll^YU 3-D perfomance vtf lability is accounted for by them, and only one-quarter 
remains to be accounted for. * / 

The results of th6 hypothesis test in MOpEL F Is shown below, stated ' 
.as a hull hypothesis. " \ " 

irypothesis; The nine covariables considered separatelj' have no 
effect on the' three test results as a unitary set, 

* i ' , . ■ ^ 

V N =^ 121 classrooms 

" df - 3/109 



Covariables 



1, Mean age in months 

2, \ Percent having pri^lous preschool 

3. Peree^Oavlng English as first jlanguage ) 

4. Pore (Hit non-white 

3. Meaamotliei'^s education in years 



V 

- r' 






lp< 


1 4. 00 


! .01 


,|/i.97 
, ,'0.920 


■ NS- 


NS 


^.95 

\ 

3.\74 


.05 
■ .03 



*FoiJ the reader whd^does not wish tO ignore the effects of these sets of vari- 
ables on intelligence tests; rosults of all regression analyses are presented 
In Appendix H, ' / ' . : ^ \ . 

All covariables ar^ expressed in clas^foom means» e.g. , mean age in months. 



Covartables 



6,^ Mean total 3-D pjre-scoro 

?• Mean total 4^ A pro-score 

8t Mean total PS I pro-score 

9. Nuix^ber vaiitl pro and post PSl 



F 


p J. 


8,60 


lOOl. 


1.'45 " 




32. 41 ' 


.'ool • 


3.21 


.03 . 



- * This Indicates that when thp reduced set of nine covarl^btes is entered 
lrft?r this newMOD^L I equation, with the Stanford Binet deleted, the deg»:ee of 
relationship the same covarlables have with the new test battery is changed. The 
effect of entering these same nine covariable? in MODELs II and ^11, where 
prScess variables are present, is again to reduce the effect of thfe covariablefe on 
test outc'ome^. It "is likely that, for example; ag^ and certain I mtile mentation ' 
processes covary so that the effect of age op tests is "adjusted'"' wlien Implementa- 
tion variables are Introduced. This statistical adjustment may correspond to an 
actual educational adjustment, i. e. , teachers may change their methods of teach- 
ing tlependiitg qn the' age of the children in" their c (asses. '. ■ 

.^^^ MODE L II - Effect of Implementation Variaioles on Test Results 

MODEL II examines the effects of tjie selected jmplenfi^ntatlen variables' 
o'n adjusted test outcomes. > The amount' of variance which can be accoCinted for 
by the nine covariables and the 24 implementation variables on e^ch test is listed 
below. - 



Test 
NYU 3-A 
NYU 4.-A 
PSI 



Percent Variance 
0.83 
0.-78 

;0.86 



The addition of the impfementation varialSles enables us to account for 
20 percent mcu^e of the'varlabiUty of PSl scores, 12 percent more of the NYU 4-A 
stores and 3 percent moire of the NYU 3-D scores. 

In the' preceding analyses of the rielatlonship between the actual degree 
of model implementation and tes^t results, it was found that a higher level of 
Implementation did not lead to higher outcomes. Several possible reasons'fpt . 
this were put forth, including the possibility that the; part of sponsors ^ models 
reflected in the implementation variables is not relevant to the outcome measures. 

^ Examination of the test of the regi'ession results above, and the results 
of the hypothesis test below, \vould seem to contradlct^thls alternative explanation/ 



Hypothests; Tho Implementation variables as a unit have no effect • 
on the test results as a'unlt. ^ 

1 ' . • . • • . . . • ,■ * ', •• ■ ■ 

, N = 121 classi'ooms . . ' 

' .. . df = 72/255 . ' .. 

• F .= •. 1*.77 ^ ; ' " 

., ■■■P' •< ...01" , ■ ' ■ -^^^ ■ ^ . ;. ; ' 

The next hypothesis test I'eveals that the sIgHlflcant effect shown above 
Is due primarily to three of the.24 selected prbcoss^variable^ designating spon-' 
sors' riiethodologles and-beliavlc^r goals.^ 'These variables are: Variable 11 
(Numbers, alphabet, reading), Variable 24 (Wide rang6 of activities), and 
Variablo 25 (Independent child actlvity)\ , " ^ " : f 

■( ■ ■ •' ■ ■ ■ ■' * .■ - . , • . 

Hypothesi s; The litiplemerttatloa variables considered cQpargtely have 
lib effect on the test results as a unit. , / ' 



N 
df 



121 classrooms 
13/85 



f m p le m e n t a 1 1 0 n V a r i ab le s 



6. Adult child ratio 

10, Group time, sharing, rest, story, etc. 

11, Numbers, alphabet, heading • 
13. Games, Puzzlers 

20. Adu^t with one or two children,, academic activity 

21. Adult with small group, academic activity 

24, Wid(b rhnge of activities 

25. Indc^po/iderit child activity 

"^G. Adi^lt ^vith one or two children 

10. Adylt tlirect question, child respb^ise, adult 
corl:e6tive feedback . . 

47, Adult Mirecti question, child response^ adult 
acknowledgement , 

48, Adult! direct question, child response, adult praise 

49, Adult open-ended question 

52. AdQi| praise to child ' 

.}3. Adul^t acknowledgement * . » ; V 

5r. AdCtjt positive corrective feedback : 

59. All phild self-Instruction . 



1.95 
fO.68 
5.11 
2,07 
0.61 
2. 32 
^3.i89 
3.84 
0.78 

0.62 

.0;58 
0.53 
1.61 
0,26 
0.76 
2.57 
0,38 



p< 



NS.. 
NS. ■ 
. 01 
N? . 
NS 
.10 
. 05 
.05 
NS 

NS 

NS 
NS 
NS 
NS 
-NS 
.10. 
NS 



Impietnentltton Variables 



62. 

63. 

69/ 

70, 

71. 

72. 

81. 



_ _j 

Adult Intotfactlon with ond or tvo children \^ 
Adait ln^ractIon wtth emali grou^^ ^ 
ChUd Initiates Interaction with adult ' ' i 

Child ihtUatefi InterablloD with other children 

' "■ ■ ■ . - . ■ ■ ■ 

Child oon-verb^l 

Child cooporates vylth other 

All motion ' 



\ 



•F . 






Mo 




viol 


Xt XJ. ^ 


fSo 


1,36 


NS 


0.55 


NS 






2.61 


' NS ' 



MODEL 111 - Effect of AdjUtjonal Process Variables on Test fieaults 



MODEL in was designed to ;:determirie whether additional process vari- 
ables, chosen because. general educational theory would link them to test scores 

re Ute to the outcomes. ^ • 

' " • * ... ' ■■. ' ' ■ 

The ^ddltlpnal process variables; as' a set,* did jpot have a slgnlflcaiit 
effect on the test outcomes. V 

' ■ ' \ ' ■ ■ ; . . •■ . / , . ■ 

Because o/^the odvarlance of the addltlorta^l variables with the original 
set of Implementation varlablesy the two sets cancetled each other's Neffects. 
Interpretation^ otresults from MODEL HI therefore do hot help us answer the 
questloh of relating Implementation to outcome. 

MODfiL IV - Effect of Fdctor Scores, on Test Results 

In MODEL IV, factor scores, wlilch were used to some extent to eval-f^ 
„uate Implementation, Were related to outcome scores, 

Itt.thls analysis, the three dependent^ test variables were regress^ 
the nine covarlables and the seven factors. ,The proportion of variance oh the 
outcome tests explained in MOD^IL IV was: 



^est 

NYU 3-D ; 
NYU 4-A / 



Percent Variance 

: , — ^ , 

0.7? • 

0/73, 
0.67 



The hypotheses tested, stated In terms of the null hypothesis, wUh 
the level of probability associated with their rejection, are: 

Hypothesis: That the factor scores as a unitary set have no effect 
on the' test results as' a unlt&ry set. 



N * 12.1 classrooms" 
df 21/293 . 

F ' = 2.75 



*' '* Hypothesjs; Thakthe factors considered separately have no effect 
/ . on the test results as a unitary set* 



N * ^ 121 classjfooitns 
df ^ '3/102 . 



Factor 



P< 



U , Programmed^acadeimlc instruQUbn 

2» Individual Children in a wide variety of activities 

3. Adulfcfeedback to children/ 

4^ Positive choice request Interaction' 

5» Negative behavior 

G. Positive behavior . ^ 

7. Adult with large group ; 



4. 68 
? 0.883 
4.10 
6.31 
2.4« 

2.30 



.01 
.01 

Vooi 
.ps* 

NS 
. 10* 



♦negatively related. 



The first observation to be made Is' that, unlike variables-TthJ majority 
of the factors had an effect on test outcomes. * , / ^ 



Although the use of factor?, is frequently criticized because of their 
difficulty of Interpretatlo'n and their nebulous nature as compared to Indtvldual 
variables, tt appears. that they hiay be more useful In explaining outcome vari- 
ability. ■ \ - ■ ^ , ; - , , ? . ^ - 

^ Factor I (Programmed acacl/mic instruction)! which was one of the 
two factors found most useful In distinguishing sponsors 'and determining ' 
Implementation, had a significant 'effect on the tests as a set, Factor? 
{Individual children m a v fde. variety of activities) did not. Three of the five 
factors that were difficult to use In. determining Implementation had significant 
effects on test performance. 

Conclusions to be^drawn from a consideration of MODELS I through IV 
seem jto be that: / 

• • Some variabfes and factors which were used to measure degree 

of implementation ate significantly related to test performance. 

. • Sortie of the related factors are those- which characterize sponsor 
programs but some of theAi (e.g. , Negative behavior, Adult with 
f large group. Adult feedback to childr'en) are those which all 

sponsors and NPV hold in common. r 



It thus appears that the variables used as critoria of lmt>lententatlon 
are not those which have;ni6st effect on test scoros, The*explanatloh of earlier 
findings, contj»astlrig well Implemented and.less well Implemented classrooms 
on test performarioe, might \vfell be that lack of difference occurred because tlie 
prpcess6s descrlbedl by thd Implementation variables were hot, for-the most 
part, th(| effective processes. ^ - : • ^ 

^^lODEL VI- Contrast of PV and NPV Effect On test Results ' 



Ol 



)ne of the.questions about Planned Variation has beenUhe lack pf 
Striking results, and whetheir'thls can be .explained, at least In part, by failure 
to fully Implement a program, • 

Vin MODEL VI, the effects of all PV classrooms are cpntra^ted with all 
NPV classrooms on th6 three dependent variables (the post-test scores), given 
the effect of the covarlables, , , 

^ \ . , , . '< ' ■ - 

Hypothesis ! Thaij^the PV/NPV contrast has no effect on the test 
resuUs' as a unitary s^t, . 



N = 121 classrooms 
^ df = ^/i08 V ^ ^ - 

/F = 0.80 ' - 

The P^' experJ.merit design designates as the comparison group non- 
sponsored Head-St^rTcenters In various sites, which receive on-going currl^ 
cular guidance from OCD, The PV models, then, are contrasted against * / 
these preschool enrichment prOgrams--not against a sample of children for 
whom no effort Is being m&de to compensate for lack of early stimulation. This 
necessarUy mitigates the recordable effects of It Js conceivable that many 
sponsors do not add to the Head Start experience any comppnents whlph add 
significantly to the effects of regijlarHead Start. \ 
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IV/ SUMMARY AND CONCLUSIONS 

^ The focus of this ; report is the implementation of the Head Start ipianned 
Vaf iation models . Specifically the scope encompasses the evaluation 6f imple- 
mentation of sponsors' classroom, curricula, iire. , classroom process and V 
;^ behavioral objectives, as these ar'ef measured by the Classroom Observation - 
Instruments '■..■■^ '-..-'^ ,■ ' ' •■ v- ' - -■. ' \ 

. Three rriajop^questlpns regarding implem^niation were addressed: 

. • " The degree to which models differ ' . 

^ ' - , ' ■ ■■-'\ . ' " ' ■ ' ' ' 

, # The degree to which models are implemented 

• The relatiortship of implementation to the outcome measures. 

Tlio results of each of these investigations are reviewed'briefly below • 

^ . . • ■ , V - . ° ■ j-^'".. . ■ " ■ " ■\ , 

Sponsor Differences ; ' ~ 

. ,„■■■-. -■■ ■ ' T . - ■ ^ ■ ' 'v , . • ■ ■ ■ ' 

Sponsor differencesVer.e ftrst 0cami^^^ • 
,cess variables selected to d^crlbe the classroom jnethodology and child 
behavior goals essential to each model. On this Jjasis, twb loose clusters of 

sponsors emerge, represented by twi> different sets of process variables 
forming several process dimensiens. f 

Examination of actual observed frequencies on the set of 24 implementation 
variables revealed as many as three sponsor groups . In the examination of 
observed frequencies on the variable $et, the three clusters could be seen 
but it was also clear that no tv/o sponsors were Identical. Profiles on the factor 
scores also pointed to- differences among sponsWs otherwise classified lii the 
same group. UP had a high score on the prbgranimed aoftdemlc factor along 
with .UK and UO. UP was also high on the factor describing 'individual children 
engaged in a wide variety of activities; thejf shared high scores with BC and R-EC. 

In all these attempts to clarify sponsor differences and similarities, the 
same three mpdelar are most clearly differentiated. ,UQ, UP, and UK are 
clearly set apart by variable descriptions of their programs, by observed 
variable frequencies and even by factor scores. " 

This 'finding may be related to the variability among sponsors regarding 
the specificity of classroom processes. Obviously, thoSe sponsors who can . ' 
provide operational definitions of discrete classroom behaviors are more likely 
to be fully characterized by the' COL Many sponsors are unable to describe 
. classroom expectations in t$rms translatable into objective, reliable ob^erva-' 
tlon categories, and they follow educational phiiosbphles from which it- Is ^ 
\ difficult to Infer specific adult and child behaviors. If ""--^ 

r\ ' ■. ' * ' , ■ ■ ■ ■ 
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In $uhimary ; more s inlilar ities appear among' sponsors than differences on 
the 24 >^ri^blos selected from the COL fhi^ finding is cbhfbundecj to some c 
extent by the GOrs greatef reliability or sensitivity to welUdeflned programs; 
and to som0^ extent by the selection of only 24 of the variables deline^ on the 
instrument.' . ! 

It Is important to remember that although sjpib^hsors may not display as much ^ 
yari^fy in this ahalysis ag- some might expect, they probabljf differ in many: ways 
outside the'scbpe of this stu^i For exampl^, it ^s obvious from other sources 
that sponsof^s differ on the delivery sy$temS| 0 

their models in itead Start ^jenters. fhOy dliffer considerably In tW^. refetion-- 
ships with the parents af^^oibiated with the centeVs, and pei^haps in other. ways 
which may be niore crucial than classroom process as'far as theii; acoept^^^ 
and effectiveness are concerne(i» One characteristic which is dealt with Only 
indlreo|ly in the SRI classrooril observation instrument fix in other Implementa- 
tion measures (e.g. , sponsor rating) Is the content o^ the Head Start programs; 
No one can deny that content is related strongly* perhaps most*strongly, to per-' 
for mane e on the tests. The preacademic measures > bej^g the mosit reliable 
instruments available, reflect primarily the Content of any curriculum materials 
provided. To ^hswer questions about sponsor differences and to understand 
differential sponsor effegts, content analysis of the modelsVcuyriculurii / 
materials would be essential. ^ . ^ 

/ >When the quostioh ot whether the^e are 12 different niodels comei? up, then 
it is necessary to clarify the dimensiohs on which it is important that they be 
different. For some puyposes* it might be enough to know that sponsors recom- 
mended 12 different sets of books arid materials to Head Start cenifer personnel. 

Sponsor Implementation 

Thb datff were examined in the light of two defining conditions for fuU im- 
plem^tatlon of classroom curricula: (1^ consistency between classrooriv 
events and sponsor objective^ ^ and (2) consistency among sites; As the Lucas 
and Wohlleb report^^ oh implementation made very clear, l^th aspects of imple- 
mentation are assymed to exist when the differential effectiveness of the models, 
is evaluated . However i the relationship between these two criteria is unclear . 
Analysis found that, although consistency between iSponsor objectives and spon- 
sor frequencies on the variables selected to reflect these bbjectiyes js quit^ 
high for all sponsors, consistency. on these same process variabies across sites 
was quite low. ^ 

* For some sponsors, site-to-site replication is not a project goal at all, 
EDC and t^e Enablers make n6 attempt to impose classroom methodologies, but 
act as consultants or advisors to their Head $tart c6nters* Other sponsors , 
sMptlliite parts of the curriculum >rid consciously leave other areas to be formu- 
lated by thjB different sites; perhaps so as to assure the program Js relevant to 
the community . ^ \^ . \ - ; . : ' / 

In the analysis of Implementation, however, even those sponsors who are 
most prescriptive in their teacher training and expectations showed considerable 
site-to-site variation on central program variables; 



• When the question "How weH ImplemVt^d is the model?" comes up, there> 
fote, it Is necessary to clarify-miat is n^^Htby "well implemefttedV" that Is, 
for what purpose Is the informatlpn heeded? For some^p It may be * . 

enough to'know only th4t the sponsored proi^ams differed consistently iErom 
NI>V on several variable^ . ■• ■ | . .v' ■ ' 

Relation; of Implementation to Test Qutoorn^ ' 

- The relationship between the ^egree to wljich.a model is Implemented and 
test outcome was explored by contrasting tl^'^ 'effectslif those dassrobms most 
consistent with, and least consistent with, s^wnsor objectives. Ko slgn^Icant 
relationship Was found between the level of Implemen^atlbn and test results. It 

, seems clear that an unambiguous ^interpretation would have been possible only - 
if "well implemented" classrooms had greater effects on the tests than "less - 
well Implemented" classrooms In ev^ry case. In this case, it could be claimed 
that when programs were well implemented, they Were' also mor#effectiye. 
However, this unambiguous result. was not the case. The limited range on both 
process and outcome data was the most likely explanation for the present re- 
sults showing lacl{ of positive relationships. A test was made" of-the possibility 
that the criteria ilsed to assess level of implemehtatlon, (i.e. , the selected 
process variables) are not relevaLnt to the outcome measu^res employed. ^ The 
results were somewhat ambiguous, but it appeared that most of* these variables 
are not related significantly to scores oh the three tests (NYU 3-D and 4-A. 

'and.PSI)./ ; ■ , ■, ■ ... 

Another question addressed through regression analysis concerns the " 
app^rentjack ot PV test effects. No significant differences were fouiidwhen 
all pv classrooms mean pssl-test scores were contrasted with those of PV. 
It Is possible that the PV models do not add to Head St^rt ai\y elements that are 
relevant to the outcome measures, or that. If they do, the additions represent 
a ^mall increment to the effects 6f Head Start itself as a compensatory pre- ' 
school program . More dramatid results could be expected if the sponsors' 
test results^ as a group or singlyi were contrasted with those.of children who 
are not in an environment enrichhient program like Head Start. yr 
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DESCRIPTION THE GJ^SSROOM OBSERVATION INSTRUMENT 
AND OF DATA COLLECTION PI^^ 
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Pescriptton of the Classroom ObservatloQ.InstrumeKt ' • 

. The SRI Classroom Observatiorvlnstrument (COl).was developed to^ssess 
the classyoom atmosphere and the teaching It provides a 

record of the classroom environment, classroQtfi activities^ and tjie interne tlonsi 
that take place among adults and children. The Instrument wds developed to 
describe the mgdeis^in tfie Head Start Planned Variation Program according to 
the stated classroom pVopess goals of th^ sj^on^ors. Thls^ Information is obtained 
by having^ trained observer record what he seus and hears in the classroom in 
an observation protocol or booklet. * ^ ^ . f 

^ '• - , ' ^ ' ■ . ' ■■.•.*''«', , . ■ ' ' ■ . . ' ■ ^ 

: The<;01 booklet cpntains two mkjor sections: the Observation Summary 
Form (OSF) for recording summary information about the classroom environ- 
ment and the Classroom Observation Procedure (COP) for recording specific 
Information about the classroom structure and process. 



Observation Summary Form (OSF) 



The OSF provides a dMly record consisUng of these parts: Identification 
• Information, Class Observation Infer niatioiirSumnVary of Classroom Environ- 
ment, Pl>ysical Arrangement and Equipment Available, Active Play Observa- 
tlonj and space for the ofiservfer's reaction to the classroom environment. The 
OSfIIs completed price on each day that the classroom is observed. A repro- 
duction of the relevant' sections of the DSF appears as Exhibit A-1; however , the 
OSF inlqrmation used in ihe present study includes only the iriformatlon 
discussed below* V 

.^-'"^^^ . I^enjtl'flcatlon Infer n\ation _ „ : ' 

. ./ \ This part of the OSF identifies the sponsor > the classroom teacKer, 
the location and observer > the grade level, the date of observatiorir An eightr; 
digit identification code indicating' sponsor, ^site and. classroom remains with 
the bbseVvatitiri data throughout the data processing and analysis % ^ 

Class Observation Information : • 

^ . , In the Clase^Observation Information subsection of the OSF, the 
obseryer records thejiumber of adults present in the classroom, the number 
of chlldi^en enrolled, and the number o^ children present on th^ day of the 
observation, and whether, on a typical day , the teachey followed a predejfined 

'^hednter'^"^ — ^ 7^ » 

•• ■ - 1 . ■ ' ■ ' ^ , 

Classroom Observation Procedure (COP) 

' /; . ■ ' ■ ' ■ ■ ■ ' /' - ~^ ■ ■ - ' ' " 

The COP is composed ofAhree subsections: (1) Classroom Check List 
(CCL), (2) Preamble^toHhe Five-Minute Observationv and (3) PiveTMinute 
Observation (FNV:)). Ond COP consisting of these three parts is completed 
approximately every,,! 5 minutes (or four COPs per hour) throughout the Head 
Start day. A repromiction^Of the GOP appears as Exhibit A-2. 



Exhibit A-l 

6lA$SR60M pBSERVAtlON INSTRUMENT * 

OBSeeVATION NUMMARY ^FORM " 



V 



( 



DIRECTIONS; Ui^ orie/OBSeRVATION SUMMARY FORM for ^ 
each d$y*$- 6b|erydtio,ri of one^e^^^^^^ tUte that all of the 

Iderttifymg Infcrrnaiio^ has b^en ehtered on th^ top half of thU page. 
I^lor to th^ ob$ervat}on. bo nOf make ahy'&Udy marks outijSe the' 
bixM provided : in ;*p[0ces vvhe^^^^^^^ irtforniatiort H ftfquir^d. 



Write here: . . / . 

the range of the seriat namberi on the forrni 
that you are using fof'this obser^'atiort. 



teacher- 



School/Center: 
Ciyy &J;ta ie:__ 
Observer: . 



Streel^Addrossk, 

City & State: 

, Tefephone / ^ 



00N0T'W«IT£ OUTS>b.E THIS SbX 



Cl ASS QBS^kyATION ^NFORMATiON 

Nu<j»bef^>f ttMchfjrs. 00 - 

Wuinfaur o1 aides: : ' - ^000 

Uo of vol Ji^iUeers present today *®0©Q 
l otj! U (ss jilurJlioti 

hr. 03X hr O 4V> hr 0!i'< hr. 
03hf: 04fJi;. ' OShr. . 06 1)^- 



oo 

©0 

00 
0® 
©0 
0 
0 
0 
0 



8 



B 



®®j A' 

©0 
0® 

t50 

0® 

© 

® 
. ® 
. 0 



' Nambernot-djifdreTi 
enrolled 

Number of children 
present today 



(Observer asks teacher:) 



tVith regard to a typical 
Jd/'s activities, do you: 



TEACHER NUMBIrJ 




NUMBER 


tOOAYSOATC 


Nc$ use 


■ .' ■ ■ - ^ f 


■M 




■ Wo^j 0*y 1 Yiiif 




®®0®®®0® 
00000000 
00000000 
®00000®0 
00000000 
00®®0000 
©0000000 
00000000 
® 00®® 000 
00®00000 


^® 

®® 
0© 

(5)0 

d)® 
00 
0^ 
0®i 


0000 

0000 
0000 

0000 
0000' 

0000 
©000 

'0000 
0000 
0000 


®0®000 
000000 
000000 
00000© 
00000® 
©000©® 
00000® 
000000 
000000 
®®®0®® 


00000 
00000 
00000 

00000 
0000® 
00000 
00000 
00000 
©000® 
0(^000 



mm 



CLASSROOM tH^ic\ 

, A' 1.' Snick, lu^ch 



CLASSROOM pBSERVAtldJ^ PROCEDURE 

o^V ; TWO . Waii 

- I G ^ " 



LISJ (b« s<jr0 to cod0 EVERYONE in th^ cla&s) 




B 



2^ 



2. Oroup tlm«. ihirlrtj, f<$t 



3. Story, f niBin^, dar>clr>g 



A <D.©© 
V 000 




A 000 
V 000 
I O0® 



T O©0 
A 000 

V 000 

r 0©(5) 




CAROE 

T 00 

]A 00 
<v 00 



4. NumlMi i. 



A 000 

V 000 



T G 



t O0® 
A 000 
y 000 



T G 



$, A|phabj«t, reading, language development 



A 000 

V 000 



I' 0 



D 



6. Finding out abo^i^)^^1e and how th^V live 



A 000. 
V O©0 



i G 



A 000\ 

V 000 



T (VJ©© 

A 000 

y 000 

< (Dg) 0 



. 7. Findiiig out about the natural wof Id 
(maghets, ihajMi.^o&nd) \ ^ 



A 000 
V O00 
* O®.0 



T ©©0 
A O00 
V O00 
I O00 



©00 
000 



O©©0 
0000 
O000 
(D00g > 



A O® 

V 00 




£ 8. Tabl^games,"gu(|Wnggam0t, working pgiifet 



T 0®® 
A 000 

V 000 
t 00® 



T O©0 

A 000 ^ 
V 000 
I 00 g^ 



O00® 
000® 
000® 
)®0 



A 00 
vO0 



J G 



Arti, craf ti 



T O0© 
A 000 
V 000 

O00 



C6ol$ing« tewing, pounding, or Mwing 



Tv00© 
A 000 

V 000 



T 00© 
A 00® 

y 000 
* 000 



T O©© 
A O® 0 
v 000 



0®^ 
0000 
O®®0 



00®® 
0000 
0000 
®0®0 



to© 
A 00 

y 00 



AO© 

V o© 
Ml 



}(ocki, trucks 



•T 0®® 
A 000 
V ©00 



T 00® 
A 000 
V 000 



T 
A' 
V 



000© 
0000 
0000 



to© 

A O© 
V ©© 



> GJ 



12. lOolU, draii up, water play 



Active play 



T O®® 
A 000 
V 000 



» Gj 



T ©©® 
A 000 

V 000 
I ®®6) 



g0gr-^ 

0®©©' r © 



AOULtS WITHOUT CHIlDRtN 



T ©(D© 

A ®00 
9 00© 

i ®®® 



t ©0® 
A O©® 



A 0000 
000® 
10©® ® 



V ®®0 
I 00® 



T 000® 
A 000® 
V 0000 
> 0©®(^" 



A 00 
V 00 



tW^ 

A 0© 
V O© 



Classroom minagcment , 

dtis«rving 

Out 0f the rooitt 
Other i -' ■ ... 



- © ® 



{dumber of Aduiti In crasiroom 

1 1 1 1 1 1 1 1 1 1 II I 



00® 

.00® 
0.00 



I Tim 1 1 



©0® 
00® 

00® 
00® 



II I 



0000 V/ 
0000 ZV 

0000; 

©000 



1 1 II 



©0 
©0 
00 
0® 



I I 



... Classroom Check List (C^L) 

The CCL records a series of relatively .static pictures (or "snapshots") 
i of the distribution of adults and ehildVen Within activities .occurring at given 
moments (four limes each hour) . Essentially,' the CCL provides a record bf 
activities taking place, group sizes, adult responsibilities, and child indepen- 
. dence. It provides 13 alternative activity categories! any of which'a class 
' might be engaged in during an ordinary day, and four additional categories in 
V which adults might be involved without children. ... " - 

• - " ' Preamble to the Five-Minute Observation (FMQ) V 

. The preamble tp tlTe Plve-^Minute Observa^;ion is sHown^as Exhibit A-3» 
It is completed-just befor^the five^mlnute observaUon period is bd^un. It ' 
\ identifies the activity that iXto be the, focus of the* observdtlons, the size of the' 
group Involved, and the aduU role, any , within that activity / It also records ■/, 



the time that the five-minute observation is begun. 
Five-Minute Observation (FMQ) 

The FMp is designect\to record the interactions ^imong adults and 
children In the classroom. FMp categories identify persbns and actions in the 
classitoom. The first two categdries, nwhorf' and "To Whonij " designate the 
classroom roles of people involved in events: 



Who and Tb Whom CaJe|orie 



Teacher 
Aide 

Volunteer 
Child 

Different child 
Two children 
Sms^ll group " 
Large group 
Everyone 
Materials: 
.CiQnfusion 



Code 

T 
A 

C 

D 

2 

S 

L 

E ■■ 

M 

O 



i 



111 
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Exhibit A-3 



K£Y 



R-R»||M«t 
Who and To VVhom . v ' 

t - Teacher * ' s 

■ A AttisWrti/Aida 

■ c - 'crthd - 

■\ b Oitf went Child 
2 - twoChifdr€rt 

S * - Small GfOtil' : 

E ^ tveryone o 

M^^* MatHiafs 
0 ConfusfOi> 

* What 



V Direct r»qunt 

: 2 CbOica f»Qu«$f ^ 

3 — Respond 

J 4^ Teach Joform 

6^'- Commfni', Play 
6 - Praise . 

- Ackrtowledfle . 
• 7 ^ Help 

6 - Cooperate 

9 - Corrective feedback. 5 

10 - No response. I ^rvore, 
» dOfi't knowy" 

11 Refuse. Reject 

V 12^^ Observe ^ 
O". H Confusloft 



How 



S n $ad 

H ^ Naftative ■ 

A -* Angry 

'0 - Culde to alter nailv 
V R * Reasort : 

C - Conuolby praising \ 

Q - (hjattiOn' 

F >- firm . 

0 - Demean 

Th - Thrtaien 

P - PunJsh 

T ^ Touch 

0 - mtci 

Sv - Symbol . ■ 



V - Verbal 
N/V "I Non-verbal 



FIVE MINUT6 OBSERVATION 
Whut'i happening? 



N\imberof Children 



*i teacher . . ........ . ; . . Q,* 

'A«J$fantMide Q . ^ 

^olunteer. 4 ... . -^ . 0 . - 



Aetivity . 



FOR NCS 




<§)(§) 



Pupil 



(§)(D 
<a><D 

00 



00 

0l 



. TIMESTARfjED 
.Hour ' . . ; fi^inute ' 

000 1 00000 
©001 000($>0 



0®000 
00000 




il2 



the third category CWhat»7 describes t^^ 

What Categor^^ ^;' \ ; Code 

Direct request 1 

Choicer request - - , 2 

Response 3 

Teaph,,inform: ^ . 4 . 

Comment I play ' , 5 

/ ^- ' JPraIs6/--' . v " ""'e* 

^ Acknowledge./^^ ' ^ jj 

Help 4 7 

* V Cooperate j * . 8 . 

Corr'ectlyeifedbaok * 9 » 

• No r6sp6nsej .ignbre/ i 10 
\ "I don't know'' 

V* Refuse, reject 'J 11 * 

bbserve , " 12 

j Cdnfuslon , ? 0 

Tjhe 'fourth category of the vocabulary ('»How»») modifies the action, 



How Category 

N<?riverbal 
JVIotibn 



Sad 
Negatiye 
Angry 

Guide ,to alternative 
Reasbh 

ConU*ol by praise 
Quest ion 
Firm 
Ptpnieah^ 
Threatei 
PunisK 
Tduch. 

Concrete Object 
Symbolic object 



Code 
NV • 

V (used In spring 
: '71 orily) 

H 
S 

' N 
' A ' 

G 

R 

c ■ 

Q ; 

F ■ ■ " X' ' 
D . ' 
Th 
P 

T. ■ 
„0-„ 



In addition, there is a symbol that tneans the entire interaction recurs 
immediately in the next firame in the sequence, II (Repeat) ; • Another symbol 
Indicates that a sentence is in erro? and should be Eliminated from the data 
set, C (Caricel). The categories a^e operationally defined and inblude elements 
of educationally s Ign If icant\e vents < . A full list'of operational def^iitlons of 
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PMO^odes4appear$.m Appendix B. Two e^i^^mples of category Ideflnltlo.ns taken 
from the observer training manual arc as follows: / | , ^ 

♦ S--Sadr Crying; slack, down-turned face; frpwn.: huAchfed-up 
, b9dy; quiet, monotonous vplcer trembling chin r^^j^ ^ 

♦ ^--Cooperate; Mutual help,- group effort. /Eff<5rt of eabh Is " 
\ affected by the efforts of other (s) ; what on^does has a direct 

effect on the other (s), e.g. ^ / , ' 

--children building a block hjpuse to^ether; • - 
"Ghlldren playing fit lotto game wlth^u^ an adult;^ ^ — > 
--Group singing. > / 

In the fall of I970;and spring of 1971, thte FMO consistfed pf 60 inter 
action frames . Each frame has four sections corresponding to the four qode 
categoric?: the »'VVho^' section, which' identifiej^ the initiator of ah action; 
the '^To Whom'' section, which identifies the petfion to whom the action is 
directed; the ''What'^ sectioni- which indicatei^n^^ action itself; and the "How'' 
section, which describes or modifies the ac|;lon. The FMO protocol is' shown 
as Exhibit A-4. The observer n\arks the c6des in each frame in sequence to 
,form a sentence de^criblng^n action. The observer codes Interaction frames 
fpr appr^^pxlmatel/ five njlnutes. Since it. takes an'observer approximately flvje 
second]^ to trandlate an action Into codes^and record It, 4 t6tal of 60 frames Is 
the expected patput during a five-min,utje pbs^ryation. Figure A-l shows a* 
sequence of three framed in which an pbserver records a teacher's question 
to a child in the first fram^, the child's respbiise to the teacher In the second 
frarfte, and the teacher's" praise of the child's work In the third frari^e: 

Revisions of the Spring 1971 i^strunierit / > 

Some revisions were made^tb the instrument after the fall 1970 data collec- 
tion and were reQected In the COI as used Ih tKe spring of 1971 . These changes 
are set forth below. ^ ' ' 

Preamble to the FlVe^Mlnute Observ<i tion 

An additional ro^i^ of "participating" was added to the "Adult Partici- 
pation" entry for the spring observations, making It possible to code whether 
ai)^dult-was-^lrecting77partlcipating^,~6 — 
'■■■progress. \ . •'\/;'-' \ ^ - ' 

'\ Five-Minu^e Observatio n j 

r ' In the fall, 1970, Code 5 (Comment; play) v/as used when a jperson 
was reading, whereas In the spring, 1971 , Code 4 (Teach, inform) was used 
when a person was reading. ^ / 

; •• ■' ■ 'v'\-/^:^' ^ ■ \, ' \' : ^ ^ '^^^ 

"in the faU|j^l970, the Code V (Verbal) was not used . Interactions were 
cbnsidered to be verbal unless th^y were coded NV (Nonverbal). In ;the spring, 
ion, the V code was used to Indicate * . 



1 




To Whom 




w sc/ vi/ 


W ViV vt/ 


ViV Vft/ . 


. V;>/ vy/ \y 




V/ vt/ Vfc/ 


^ AfQ 

Vj/ 






©0 



What : 



How 

<S)©<a)® 

©©©© 
©©© 



2 


Who 


ToWhOrti 


. What 


V How 


® 
© 


©0© 
©©© 

©0© 
©© 


©®© 
©©© 
0©© 

©©. 


©©©© 
0©^© 
®®00 
0©©© 


©©©© 
©©©© 
0©©© 

©©© 








■ Who 


To Whom 


What • 


How 


© 
© 


00© 

©©© 

©0© 

©© \ 


©0© 
©©© 
©0© 
0© 


0©®©. 
©®©® 
0®©© 
©©00 


©©©© 
©0©© 
©©©© 
0©© 




4 


Who 


To Whom 


What ■> 


How 


© 

0 


©®© 
©©© 
©©©. 
©© 


0©0 
©0© 
©0© 
©0 


©©0© 
©0®© 
©000 
©©^0 


©©0© 
©0©© 
©®0^ 
©©0' * \ 



5 


Who 


To Whom 


What ^ 


How 


0 
© 


©00 
©0© 
©©© 

00 


©0© 
©0© 
©00 

©0. 


0®®0 
®®0® 
0000 
0(^0© 


0©®0 
©©0® 
0©©0 
®©0 






6 


Who 


To Whom 


■ What 


How 


0 

© 


d©© 
©©© 

000 

0© V 


O©0 

©0® 
0©© 
00 


©©©0 
0©®© 

0000 
0©©© 


©©©© 
0®©© 
©000 

,©©® 



T 


Whci; 


to Whom 


What 


^ How,^ 


© 
0 


©0© 
©00 
00© 

©0 7 


000. 
O00 
0©.0 
0© 


©©©0 
©^^00 


©00© 
©©0® 
000© 
000 





Who '■• 

000 
©0©. 
00© 

y00^; 


foVVfioA 

O©0\ 

00® 

00© 


.©©©0 
®©0© 

'©©!©© 


. How' . 

©©0® 
0©©@ 
0000 

•00© 


1 1 III rr^ 


1 1 1 1 1 111'^ 



9 


Who •, 


To Whom 


-p 

What , 


' Mow 


© 
© 


0®© 
©00. 
©0© 
©0 


000 
0©0 
©©0 
©0 




©00 










10 


.Who 


To Whom 


' Wfhat . 


How 


*©. 


00© 
©®0 
©00 
©0 


0®© 
©0© 

®© 
-J- V- 


(1)00© 
0©©0 
000© 
©©0© 


0©00 
0®©© 
©0©® 
©®0 . 




What 

0000 
0000 
0000 

0®(© 



How 

©©00 
©0©0 
©0©© 
©©© 




What 

©®©0 
0000 
0® 
0® 




13 

0 
© 



Who 

00© 
©©0 
00© 
0® 



To Whom 

©®© 
00® 
000 
00 



. What 

©00® 
0®<J)0 
0©00 
0©|©0 



How 



©©0(g) 
©©0© 
©00® 
000 





14 


Who 


to Whom 


What 


How 




0 
© 


©0© 
©0® 
©00 

00 : 


©00 
©0© 
©©© 
©0 


©©©0 
©0®© 
00^g 


©000 
©000 
©0©0 

0©©. 



If 


Who 


To Whom 


What 


How 


© 
© 


©©© 
©©© 
©©© 

0© 


0©© 
©©© 
©©0 
00 


©00© 
0000 
0©©^ 
©©10© 


©©©0 
0®0© 
©000 

0@0 



lis 




What 

©©00 
©©©©, 



©© 00; 



How 

00®© 
©000 
0©©© 
<j>©<g) 



r 



' ■ . Figure A-1 ' v , 

EXAMPLE OP THREE CODED FRAMES 
FROM FIVE-MINUTE OBSERVATION PROTOCOL 



Teacher : (toucW?ig child's shoulder) 
- "Did you finish the puzzle?" 
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Child! ?'Yeah, I go^ all the pieces in. " . 
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Teaqlier: (smiling) "That's fine- 
. ' you did a g6od job." 
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^ Selection and Training of Classroom Observets 

SRI Site Coordinators at the observation slte^ were given the responsibility 
for selecting and hlrin lassroom observers for the lo<iai communities accord- 
ing to guidelines thai phaslzed the^ ability to (1) learn symbol-concept rela- 
tionships, (2) maintain objectivify toward behaviqr observed, and (3) hold as 
confidential all data collected. General IhtelllgeiKe and memory flkllls were 
considered more important qualifications than ae'fdemlo credentials/ 

Each observer received a training packet in advance of training that included 
the list of cOdes.and de.finitions, solf-tests,. and flash cards for home study. 
Before coming to the tr&lning session, each observer was tested on knowledge 
of the codes by the SRI Site Coordinator. > ' > . 

'.' ' , _ ■ . ■ , ' ' ■ 

In^he fall of 1970, three five-day training sessions were held! the first 
jvas held in New York City; foi- observers froi{> the northeastern states ; the 
second In Atlanta for observers from the southeaster ri and southern sUtes; the 
third in Denver for observers from the. West, Southwest, and Middle West. 
Approximately 13 observers were balned in each session by three trainers 
from SRI. . ' ^ . ' ■ 

In the spring of 1971, a one-day refreshef training session was held for ' 
returning observers In Denver. One-day refresher sessions in Philadelphia 
and Atlanta ivere als9 S^'von to returning observers prior. to a four-day training 
session for ne\y observers. The sessiojJs were conducted by three- or four- ' 
membjer SRI training teams. / - : • 

^ Training, for beginning observers consisted of explanation and demonstration" 
of the coding of 'each pai^,t of.the CO instrument, coding practice from'role- 
playing Situations and videotapes, and threo mornings of live 5ole-playing 
situations and videotapes , and three mornings of live obsemtlons in classrooms. 
On the final day of each training session, .a priterion videotape was presented to 
the trainees for coding. Those whose speed and accuracy did hot meet a mini-' 
mum standard of 80-perdent agreement with the frequencies and code content 
Of the established coding standard were given an additional tape to code. Ali' 
but. one of the trainees completed the tralninig successfuUy . A r^lacement for 
the unsuccessful trainee ivas'subsequ'ently trained at SRI headquarters In Menio 

■ Park / ■ ■ 
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An asse ssmerttjof the reliabilit y of the pbser vatlon protocOls dur ing analysis 
lo data revealed Mo problems . One 'of the observers had misused code! 
and had failed to completely fill In the protocols. Since sO mucli of the data . 
that she collected Was not usablfe, the site at which sHe wa/ observing had to be 
di^pped from thd set to be included in thb analysis. ¥he other problem was 
th£ t nearly all observers exp^iri^nced difficulty in using tie codes fOr, "Objects" 
(O) and "Symbolic!- (Sy), This nhade It Impossible to us fe variables based on 
these codes in most of ^he analyses. / 
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The 1970 -71 ClasSrooftvO'bservatlorl Sample and Procedures •. ■ ' 

The origlnatdesl^n of the classroom observation sample called for obser- 
vations in three. Head |Start Planned Variation (PV) and three Head Start com- 
parison classrooms. I The number of classrooihs was later increased to four 
PV at each site and fpur or more-cdmparispn classrooms for each sponsor; 
thus observations at;tliese sites were cpnduc.ted in every classroom in which 
pupil testing was don6, The slltes in which the observation proceduVe was used 
are listed in TalJle A,f IV 1 . ■ . - . L. - v 

■ ■. _! • I . . - ■ ■ ; ■ \ ■ 

^ observations Were conduotfed on two consecutive days in Wch classroom at 
a rate of approximately four COPs per hour , This resulted in a total number - ~ 
of COPs per day_ ranging from eight to d2, depending on. the length of the Head 
^. Star t 'day v':v:^:-V''^-'/:V [,'^-0$-^^^^^^^^^^^ 

■ * observers were^ urged td Record a representative sample of activities In 
- each classroom. T6 this end, they were Instructed to observe each Of the first 
13 activities listed dn the CCL, if those activities were a part of the-daily rou- 
tine in the cl^ssrooijtv. If some. of these activities were hot included ir^ the day's 
scheduler obseryers were to observe more in the activities that did 

, occijr. In addition to the. activity categdrles. to be observed, specific groupings 
of adults and cliiidr^n were to be selected as the fodus of bbservatiohs. The --^ 
following groupings Were designated as important tq' observe: teacher with a • 
lai*ge group, teacher with a small group, teacher with two chilr?ren, and two ' 
children working together with6ut an adult. \ ' ' ' 



Table A-1 * 



CLASSROOM OBSERVATION SAMPLE FOR. PAtfi 1970 AND SPRING 1971 
, Sponsor 



02 Far >Vest Laboratory for 
EducatlonaLResearch and 
Devdlopmen) ' 

03 University of Arizona 1 



05 Bahk Street College 



07 Unlverslly of Oregon 



08 ' University of Kansas 



09 Higyscope 



10 ; University of Florida 




11 

12 
20 

26 
27 



Educational Development 
Center 



University of Pittsburgh 

Responsive Environment 
Corporation / 

New York University 

Enablers 



community 

Duluth, Minnesota 
'St. Cloud,* Minnesota 
Fresno, California 
TacomaJ Washington * 

La Fayette I Georgia . 
Albany,* Georgia * 
Lincoln, Nebraska? 

Boulder, Coioradd ' 
Wilmihgtbn, Delaware ^ ' 
DeLa\yar,* Delawarei 
Elmira, New York ; 

East St, ]pouls,t''minois , 
Tupeld, Mfssis^lppi ; 
East ]Ua^, Vegas, Ne,w Me*cico 
;West Las Vegas V New Mexico' 

praibi, Arizona 

Acoma,t New Mexico 
' Portageville, Missouri 
' MoundS) Illinois ^ 

Ft. Walton Be&ch, Florida 
Pensacola,* Florida 
Greeley, Colorado 
Seattle, Washington 

Jones boro, Arkansas 
Chattanooga, Tennessee 
Houston, Texas j 

Washington, E).C< 
Patcsrson, New Jersey ) 
-Johnsten-Gon- North-e^lin'a ^ 

LQck Hayen, Pennsylvania ^ 
Mifflenburgi* Pennsylvania 

kansas City, AJlssouri ; 

St. Thomas ,t Virginia , 

Billings, Montana 
Colpr^ido Springs , Colorado 
Bpllows Fails, Vermont 



*Off-site non-planned variation comparison. 
tPall 1970 only. 



119/ 



V 



ill 



f 



\ 



• I' 

Appondi^x B ' 



o » 



\ ■ 



* ^.OPERATIONAL DEFINITIONS 

■ OF FIVE-MINUTE OBSERVATION COp^^ IN THE 
, CLASSROOM OBS^tlVATION INSTRUMENT / 
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^ *'Who!IColumft / 

T^h^r g-";i|>e one porsort who is ultinat^ly reaponslblo for the 
everyday conduct of the olasii^om, ' ' - • 4 

Aagigtant/Aide t Classr^i^m aoults Who are regular^ in their ♦ 
attendance and are; paid through Head Start funds, 
Volunteer } Ahyoth^r adult in the olasflrpora, such as a parent.- 

on a specific child I 
that Child /is "p^V (other children are "p" Different OiildO 
When the focus is on an adult, V refers to any individual child 
with whom the adult is interacting} a second child coioing^lnto 
the middle of the interaction would be coded as ^-^y ^f -^'^^^^^ 
Different Child s A second child in interaction wheri the focus • 
child is being Observed* 
Two Children ' 



1 



Small Group ; Three to eight children. 
Large Group ; More than eight children. 
Everyone ; Adults and children In unison. 

Materials; jgio. a Record player, Tape recorder,- T/ (where the 
9jild is beini^ acteji upon by the ''Materials"). U^e CQder"M'* 
for Materials as in the following examples; Chili^ to Materials ^ 
"CM" or Materials to Child "mC; when the interacJion "Who to Whom"' . 
is going on directly betwefn a child. or a teache J' and materials, -and 
when there Is no other person involved in the interaction. ' ~ 
Confusion ; Fqr some reason the situation makes iti impbssibie ,fpr " 
the observer to' tie 11 wHo is doin^ the talking or/acting.- For * 
example, so many people may. be talking at once that the observer' 
can't tell who Is'saying what, " i 
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"To Whom" Columi!> 



"To Whom" the "Wlio" ^ talking^ to or "interacting with. 
T 
A. 
V 
C 
D 
2 
S 
li 
E 
M 
0 



These codes are all the sahie as the codes for "Who" except 
that M Materials r- '.'To Whom" refers to materials which 
can be acted upon, e.g. a lump of clay^ a workbook,/! record 
player, etb, . • 





^ . 


Who . 


To Whom 


What 


« 


<§) 

©. 


-^©® 


©0© 
©0® 


Od)® 




©®® 
®@ 


©©© 
®®® 
®@(© 



»® 



How 

©©(3)®j 
"©®©@ 

©©© 



124 



happens might be either verbal (someone talking oi* reading out 
loud)| or non-verbal (someone' pointing J or frowning, or walJilng/away)i 

1 - Direct Requos t: There is one expected,, acj^eptable response, A 

person is directed to respond with specific informatlctn or action, 

e,g,' Can you tell me how many dots are on this block?" 
''Sit down, please,'^ 
"What street do you live on?" 
"Teacher^ I wanna paint." , 

2 - fcholce Request : There is raoro than one acceptable response, A 

person is requested to respond with his oWn ideas, opinions ,'^or^ 
actions, ^ '■ ' , 

e.g, "What do you think is in the ba^" 

"Mak^ whatever 'lUnd of painting you like," 

"Hqw does it'' feel to you?" 

• - • ■ 

3 - Response s Response to what goes Just before. It may be informa- 

_ , ■ - * ■ ' . ' . , , If « 

tion, opinion, or action which follows a reques.t (1 or 2) or cor* 
rective feedback (9). V 

4 - Teach, Inform : Gives Instructiqnsi rules, information, 

e,g, "Flowers have roots under the grounfl," 

"if we put these together, we'll have five," 
'Next, add two cups of Rice Krispies," 
"You can have another turn wheri everyone else has ^ 
had a first turn;" ^ i 
• ■ ■ /. , ^ ■ i ■■ ■ ' ■ , ■ ' 

5 - Comment, Play ; Conversation, greetings, comments, dancing, ^ 

playing, pretending/ Reading a story. ^ 

e.g. "Hc^lio," 

"l like to ride bikes," . 
"My baby is sick." 

Dressing a doll, washing play dishes. (Non-verbal) 
"Once upon a time there were three, bears, • ," 
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"Wh&t" (cpntlnued) ' . . 

'6 - Praise : A compliment; nice words said to or about a i^risqA or 

- . ; ■ ' ' ■ , ' ' -f'i^ ' ■ • 

<J*^i8 contri Material reward » such; as a to&n/ 

e.g. *'What a prertty picture/' 
. "That's a good questioh, Joe/- 

. Giving a token, (Non-verbal) ; ^ 

Smile and Nod> (Non-verbal)/ 

- Acknowledge ; Repeat another ^s statement immediately, lndlcat^.ng 

that something is understoojd or agreed with. * 

e.g. ''Th&t's right/*' * 
Nodding/ (Non-verbal) . ' 

7 - Help ? Tying shoQs, putting on apron for someone, etc* 

8 - cooperate : Mutual hQlp, group effort. Effort of each is affected 

by the efforts of otl^r(s); wh^t one does has a direct effect on 
the other (s). * 

' e.g. Children building a b;oclf house together, (Non-verbal) 
y , Children paying a lotto game without an adult. 

droup sinking, - . ' 

9 " Corrective f6edback t. Telling or showing that a response is wrong, 

ClassroprtTcontroi techniques (be sure to code '^How".) 

e,g; /'No, you;\ card is not Just like my card/^ 

V. "j^mesj stop that!" ' ^ 
re you sure tHat three and four are eight?" 
Tapping a child who is out of -turn. (Non-verbal) 

/'Will you Gouht it again?" 

10 - "I donVt know" ; The verbal statement verbatim* 

Wo re/pon se, Ignore ; Interaction, Is directed toward a person who 
maHes no response to It. (Non-verbal) 

e.g. A c'hlld calls out an answer to the teacher's question, 
/' but the, teacher responds to a cliff erent child. ^ 
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"What" (continued) 

II -■ Refua6t Re.lect t Show dlaagreeraent 'or lack of acceptance Of 
^ ah Idda I suggestion, or behf^viofT 



Shaking off someone ' s touch . (Non-verbal) 
"Go away." 
"1 don't want to." 



12 - Observe ; A child or an adult is watching others in the room 
. ' to the exclusibn'of carrying oh other activity at the momenti 
^ (When the classroom observer is focusing on one Child exclusively 
which happens in '•individual child" obieryations, the "l2" cate- 
gory 'Observe* becomes very important kince the observer wiU use 
it when the focus child is watching sdmethlng or somebody else, 
and is not concentrating on his own activity.) ' * 
, 0 - Conf usion ; The observer is cwif used 'about what is going on or 
what tp score .'.either because too much is going on in the situa- 
tion to be able to distinguish and categorize the parts, or 
because the observer himself' loses, track of hi9 place./ 

e*g. Observer draws, a momentary blank on one coding, 
and has therefore broken his coding pacd. He 
notes "o" in his records, to indicate that his 
recpi^ding of the interaction is not continuous. 
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INDICATION OP VERBAVNON-VERBAL 

Fill in the appropriate Circle for the coded event, either verbal or 
non-verbal. If the event includes some of both, fill in the circles in 
both verbal and non-verbal columns. (See example above.) 



Affeot 



Classroom 
Control 
Use ifith 
'%at" (9) 



^ How" Column 

"How? is what we call the affect j>f the aotioh and classyoom control « 

H - Happy 8 ^mlle, laughter large or free body movements '(jumping Wp 

and downi clapping); varied Intonatlonj voice tone up or llghi; ; 

spontaneously huimding or singing; exuberant « 

S - Sadly s , Includes fe&rV Crying; sUck, down^'tumed lace; frpWrti 

hunched-up body; qUiet, monotonous voice; trembling chin, ^ 

N - Negative : Frown, strident tone; restraining (might also include 

V code '?T*' a Touch) » / ' 

A - An^r^; Tight closed face; frown; yelling; extreme high or jlow 
intonation; tense body, clenched fists; stomping; namecalling} 
throwing things; sulking* . 

: ■ " ■ ; ■ ■ ' -y-." r/:-: ^'::- 

1 0 Guide to Alternative : Classroom contrbl where the person is re- 
directed to a more acceptable response* 

e»g. /'Come on,f I'll push you on the s^ing;'* when a child 
^' is arguing with anothj&r child over a bike, or f 

The tet^cher )^egin§^inging a isong at a time wheriSthe 
children ai*e nois^^ Aijd .everyone joins itti \ 

R - Reason* Reasons are given, or a child's reason is ai^pealed to, / 

^ in order to maintain c^^sroom control ♦ 

.ments o|^ rules and/or social hOrms; 



"Reason'^ includes stiftte* 



e*g» "Janet would be unhappy if you took that.'* Or 

"You'll have to be quiet so others can hear the story 

Control by praising ; Praising a child who is doing what is 

wanted to get others to do it, too. 

""^e.g* "Janet, I like the way you have your hands in your l^p," 
when other children have their elbows on the tabV^;* j 
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"How" (coiitlnued) 



Q <iue8tlon r Askltig a quostlpn to point oUt a ttlBtako, 
e'.g, "Ar« you 8ure'?!i<^or 



F - 



!Th 



"is your box ju$t like my bwc?" 
Firm Command ; A firm controllilg statement* 
"Sit down!" 



e.g. 



"Don't do that." 
"stop it}" 



D - 



P - 



T - 



fieroeanj Reflections on a person's character or ability, Unkind 

practical jokes, name-calling or laoellng, puttihg-down/ 

e.g. "StupldT^ 

*'Why can't you do it like David doei^" 

Threaten : An ultimatum with stated consequences; 

e»g. "If you aren't quiet, you'll have to stay In at 
recess/^ , . 
"if you touch It, I'll hit youi" ; 

jPunlsh: Withholding or withdrawing privileges; atrlklng, (see 
Code 'V), 

Touch : Any physical cbntact, ^ - 
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REPEAT and CANCEL ' - ■ 

■ ■ ' ■ ' ■■ ■ • '.'.*'■- 

Repeat ! If the interaction you are observing Is continuous, 
^mark R every five seconds* 

C - Cancel! If an error has been made, fill In the circle C to 
panceX coding, ^ f. * V 



Used with 
' 'How" I n t e r ac 1 1 on s 



0^ Concrete Object : Any real material (not a substitute or i symbol, 

for It), ' 
Sy ■^ Symbolic Object : Any representation of something else, such as 

written or spbken words, numerals or coins. * 

^ ^ — »>. 

How • 



Who* 


To Whorrt 


p . What 
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' , Appendix C 

OPERATIONAL DEFINITIONS Oi^ THE VARIABLES 
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^ CfcL Variables V • 

CCL Variables 9-18 ^fiow the projiortloa of time the llstod activities 
occurred in oach classroom. An activity was counted as occurring If one 
or more cKlidren was engaged In the a9tlvlty» \ ' 

■' " .. ' .-^ ' . ' ■ ■ " • ' ■ . ■■ * •■' ^ " ' ' 

For each of these variables, a COP was examined for the occurrence 
of the activity ; If the activity occurred, the value' wbs assl!gnod to the 
variable for that COP, bthex^lie' a zel^o wa^ The final value 

of each variable, Is the average over &11 COPs for a class^ 

&) ActlvltJ|A - Snjick/ lunch * o 

10) Activity B— Group tlmeV sharing, rest story, singing^ ; 

• - , ^d$irclng ^ ■ jl . ' . ■ 

11) *^ Activity ^ - Numbers^ alphabet, reading/ language develop -^ : 

mo lit 

12) Activity D - Flndlpg out about people and how they live, 

finding out about the natural world (magnets, 
' shapes, sounid) * 

13) Activity E - Table games, guessing games, working puzzles 

14) Activity F - Arts, crafts,*^ cooking, sewing, pounding, or // 
] '.. sawing . ■ ■ " .^.y, 

15) Activity G - Blocks, trucks, dolls , drpss-up, water play / 

16) _ Active play . ; - V 

CCL Variables 17-22 show the average number of the Indlcated/grdup- 
lags likely tn be seen at any given time In a classroom* The value is 
found by counting up the occurrences of the Indicated groupings/ for feach* 
COP, summing these frequencies for over all COPs and dividing tjy the 
number of COPs » * / ^ « 

17) Adtilt with 1 or 2 children In any activity ' /' 

18) Adult with small group in any activity ; 

19) Adult with large groupb in any activity 

20) Achilt with 1 or 2 ^children In any academic activity 
C 21) Adult with small group In any acadcmlc'actlvlty 

22) Adult 'with largo group In any academic activity < . , o 
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; CCL Variablo 23 jgives tho average tiumber of any klnf of grouping 
llkoly to bo soon at any given time in ahy|of. tho academic Activities, 
Computation ii^ same as for CCL variables 171-22 • 

■ ■ ■ ■• . 

23) Academic activity grouplogs- 

24) iVide variety .of activities ^ This lariable indicates the 
range of differont activities likely 
given timSe, Each numbered activ/tyt (l/oi, activltlOB- 

i \ 13) on the CCL is examined fbr bccurroace; The riUm- 

)>■ ber of difforont activities occurring on each COP is 

summed over all COPs) then divided by tho number o| CpPs 

fpr a class. ^ 

J : ' ' ^ ' ' ■ ' ' ' ^ '.^ " -'^v; / ■■■ 

25) Independent child activity - Average number of groups of V 
children working Independently at any glvbn time » ' 

26) Teacher interacting with 1 or 2 chtldiren tn any activit^y 
Gives average occurrence of this grpuping likely to be 

^ se6n at any givon time* ~ 

27) Aiders, participation in academic activities - Gives 
average occurrence of any grouping of children with an 
aide likely to be seen at any one time/ ^ 

CeL-yaTiabies~28-3 l^glvS^l ReTverage^Tnum roup i ftgs 

of , children with or .without adults in any activity including classroom 
management activities, ^ ' 

28) Grojips of 1 child . : 

29) ^ Groups of 2 children 

30) Small group % ■ / \ 
;3l) Large -group 

32) Aide's, participation In any activity - Gives average - ^ 
nupiber of groups an aide or aides Is likely to be soon 
with "at any given time, . V 

Variables 33-36 give the average number of adults likely to be seen 
working alone In the Lndtcatpd classroom management, activities at any 
given time , ' 



33) Cladsroom managemdnt* 

34} Observing 

'35) Out of the room 

36) Other \ v 



37) vNumber of frames actua|ily coded for a clasdi. 
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Tp , . V V TO 

FMQ Variable . W}fo WHOM WHAT HOW WHO WHOM ^WHAT , HOW 



TO 

m> mm what how 



3S 



Adult informing Child using symbollo objects 



39 



Adult infor ping child us l^ftg concrote objects 




40 



Adult, informing child 



E! 



D 

2 > 
S 



4> 



Adult direct request to chVld 



D 

i 2 
S 



42 



43 



Child response to adult direct request 





Adult corrective feedback to chiid response 



D 
2 
S 



El ' 



44 



Adult acknowledgeffieftt jo chil4 response 



El 
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mo Varlablo W>K) WHOM WHAT HOW \ WHO WHOM WHAt' HOW 



. ' TO . . ■■■ '/^■■^ 
WHO WHOM WflAT HOW 



45 



46 



47 



48 



49 



Adult p ri^ jge: to ,chl id responH^ ;'! > 





Adult direct request followed by child response followed by adult correotive 



feedback 



2 
S 




Adult 'direct request followed by child response^ followed by adult 
^ acknOM^ledgement . ^ ' " " 




i-i 



ir 



0 <^ 



Adult direct request followed by child response followed by adult praise 



D 

2 
B 



AdUlt^ choice request to child 



1:1 



li 



6 . 



Iv 



SO 



Child response to adult choice request 



It! 



D 

2 
S 



^MO VJi Ublo 



61 



mo 



TO 




1 



^ 1 



53 



51 



55 



56 



o7 



mm uu\r 
i 



now 



Extondod child ^Vyppnso io adujt cholco roj^ucst 
0 




^^ AduU praise child 



Adult acknowlcdgomont ^to cKlld 



6 



Aliult positive corrective feedback to chtlit 



Adult ncpatlvo corrective ft'cdbnc '- to Vhi Id 

J) H, 

All adult corrective feedback to child 
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d itld so.U-instruct ion^ using symbolic objects 



C . 



* 2 
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.TO 

t.'MO Varlablo mO MiOM WllAT? HOW 



TO . TO ^ 

mJO V^XOM WHAT ilOW WiO WHOM WJlAf HOW 



58 



59 



60 ; 



c 


C) 




d( 




'2) 


All 


child 


C C) 




2 


2) 



A 



Child asking questions of adults 



61 



1 

2; 



Child self express lon\ general ^comments 



5 (not NV) 



•02 



63 



61 



65 



Adult interaction with 1 or 2 children 



r 

(v 



Adult interaction with small group 



Adult interaction with- largo group 
Tj 



Adult negative. behavior 
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FMO Varlabl 



TO ' 

WHO WHOM WHAT >JOW 



TO 

WHO , WHOM WHAT MOW 



TO ' 

mo \iHos\ 



WHAT HOW 



66 



Atfult positive, beh«ivlor 



67 



A 



iHTl 



Child. negative behavior 



68 



DJ 
S 




C hild positive behavior 



O 



IHT) 



69 



Child Initiated Interaction with adult 



70 



It; 



1; 




dhild" initiates Interaction with other child 



71 




Child non-verbal 



l "3NV I , 

- ; 9nyI -I 

_ J lONV / 
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KMC Variable mo, WHOM mWT HOW VfliO ;)(H(M WHAT 



72 



HOW 



Child cooperates 



WHO 



TO 

WfiOM WHAT 



HOW 



73 



Adult to chfld positive touch 




HT 



74 



Adult to child negative touch 



75 



Child gives positive touch 



HT 



IS 



Child gives negative touch 



77 



A djlt helps child 



(T 

A ' 
Iv . 



78 



Adult refuses, rejects child 
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'/ ' \ , 'to / . TO ■ * . . TO 

; FMO Variable WHO WHOM WHAT HOW WIK) WJIOM V^^^AT KOW. WHO • mm .WHAT HOW 



79 hhlld totuseB, roleots adult 
T 11 . 

80 Child Interacts with machine 
M - or M 



81 . All motion 



EKLC 



IV I 



,81^ All posltlvo bohavibr 

)H j 

- • - - (HTl 
83 All negative behavior 



X. 
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Appendix D . - ' 

DE;sCRIPtION OF^THE OUTCOME MEASURES 



The InatruBients 

Six outcome measures were adnjlnlstered In PV during 1976-7l'. Theso 
included the California Pre-Sc^ool Social Competency Scale, the NYU-developed 
Early Childhood tests, the Preschool Inventory. (PS 5, the Stanf9rd-Binet 
Intelligence Scale, and the Motor Inhibition Test. Data; from two of these, the 
Motor lnhlbltlpn Test and.the Callforiila PrQ-School Social Competency Scale, 
were not included In any analyses in this teport. The classroom processes 
measured by the COI are not expected to relate in any systematic way to motor 
skills or impulsive behavior and therefore the Motor Inhibition Test scores 
were nbt used. The Pre-School Social Competency Scale was not Included 
because it is a rating scale administered by the teacher whose progress toward 
implementing a model is being assessed; By using only objective test measures 
of children's performance, it was possible to avoid having the results con- 
founded. Descriptions of thie outcome measures included In the present analvses 
follow. . , 

New York University Tests (Booklets 3D and 4A) 

The NYU tests, adapted from measures developed for the Early Childhood 
Inventories Project (headed by Martin Deutscli) are measures of preschool 
achievement designed for use with children with characteriscics similar to 
those of children in Head Start. 

The three subtests in Booklet 3D are: (1) Pre-mathematics, seven Items 
assessing basic concepts of quantity and order: (2) Pr'e-science, seven items 
assessing relational concepts like height and width; and (3) Prepositions, five 
items assessing the comprehension of common prepositions like "behind." 

The three subtests in Booklet 4A are: (1) Alphabet, nine items assessing 
recognition of capital letters; (2) Numerals, six items assessing recognition 
of numerals; and (3) Shape names, three items assessing recognition of "heart " 
"diamond, " and "rectangle." ' .' 

The Preschool Inventory (Bookle t 5) 

The Preschool Inventory (PSI) was developed by Bettye Caldwell for the 
Head Start Planned Variation evaluation to measure achievement in areas 
essential for school success. The items are divided into four main areas: 

(1) Personal-Social Responsiveness, 18 items assessing knowledge about 
the child's own personal world and his ability to get along with and respond to 
communications of another person. 

(2) Associative Vocabulary, 12 items assessing: the ability to demonstrate 
awareness of the connotation of a word by carrying out some action or by asso- 
ciating to certain intrinsid qualities of the underlying verbal concept. 

(3) Concept Activation— Numerical, [15 items assessing the ability to 
label quantities, to make judgments of "niore or less, " and to recognize 
seriated positions.^ 
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*{4) Concept ActiykUon-^Sensory, 19 Items asses3lng the awareness olf 
?'ensory/attributes like shape, ^lEe, niotlon, and color and the ability to demoii 
stratb Specific visual-motor configurations, such as '^wltilch way dbes a ferris 
wheel go?" . , , . 

Stanford-Blnet Intelligence Scale» Reylsed Edition^ Form L-M • 

The StanfprdrBlnet Intelligence Scale is an age-scale test bas0d upon the 
assumption, that general Intelligence increases with age. Subtests for ages 
two-thtee contain nonverbal tasks-"--e,g» , building blocks , stringing beads-- 
but later subtests Include vdpftbulary, analogy, and number tasks* Aftfer a 
ohild's mental age has been determined, it is converted to an intelllgeftbe quo- 
tient (Qjstlmated intelligence score) using Pinneau's revised IQ tallies, * The-^ 
Stanford-Binet Is just as much a measure of experience and achleverhent as It 
fs oMntelligence, and it does have high predictive Validity in terms of future 
school success, ' ' , ; ' 

The Sample ' / 

• - ^ -.'■-\.-\ ^.' ^ ■ ;-, 

These outcome measures were administered by SRI in all PV andvcompari- 
son sites in the sample, The Huron Institute, which was responsible for 
analyzing the data and report^ on HSPV effects, converted the raw test 
data into usable test scores. 'Huron did not compute test scores for two 
sites: (1) Unl^^rsity of Kansas' Oralbi (Arizona) PV site and its compari- 
son group, Acoma (New Mexico); and (2) Far West'd Fresno (California) 
PV site, which had no comparison group. Th^ braibi and Acoma sites were 
dropped from the sample because It Was considered that these American Indian 
sites were not only not comparable either Jo other HS sites or to each other, 
due to differences in language and cuIt^re, . The Fresno site experienced con- 
siderable controversy and at the end of the year decided against continued asso 
elation with the model. Huron decided that this situation not only affected the 
center and its community, but also the quality of the data collected there. 



^L. M.'terman and M. A. Merrill, Stanf ord-Bmet Intelligence Scale: Manual 
for the Third Revision Form L- M (Houghton-Mirflln, Boston, 1960) . ' " 
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V Appendix E . • . ■ 

MEANS, STANDARD DEVIATIONS, AND. RANGE TESTS*Or HEAD START PROGRAM SPONSORS ' 
AND NON-SPONSORED COMi^ARlSON PROGRAMS CLASSROOM OBSERVATION VARIABLES 
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Adult with large group 

Adult with 1 or 2 children In academic 
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Adult wltK a»»U group in acadeailc actlvltlM 

Adwlt with large group m tcade«ic ictivltlea 

Acadbsic activities 

Wide variety of activltlea 

Independent id activity 

Ad^lt with t ;<i? 2 children ' • ' 

Aldea*' partlclpafcton in acadeaic activities 

Groxipa of 1 child 

Saiall i^roup^s * 

Large gr'qups • 

Adulta without children: 

ClassroOai Mana^eMent 

Observing • 

Out of the rooB 

Other * . 

Ald^'a parttc^pstlon In all sctivitles 

MuBber ol IraaeS foi- tails class 

Adult inforMing child 

Adult direct re<tue*t to child . 

.Child response to adult direct request 
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■ - • ^ * j 
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Adult preise to child response ' o 

Adult direct request folMwed by child 
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Adult ijllrect request followed by child 
response foU<Jwe<« by adult acknowledgient 
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NS 
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.05 
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. 603H • 




.50' ; 
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NS 
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.3964 
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23.8162 
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NS 


.5N^ 
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.1219 


,0738 
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.01 


.31 


N^ 


.50 
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1869. aO. 


100.0267 


,001 


2»49 


.05 


6«97 


\01 


1.848 


•1 




1.8160 


2.1010 . 


}<9$69 


.6680 




.31 


NS 


,68 


NS 


.402 


Its 




•5^6105 


4 . 2377 


4.9391 


?.0529 




.16 


NS 


.54 


NS 


.271 


NS 




1.60^6 
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Acfult. dlr^M' requciit followed by chil<i 
resi^onte foUoved idult praise * 

Adult chdlc^ request td child ; 

WndT^pOMft to *dult choice roquftit 

Extended child rebpoht^. to adult choice 
rcquoat question ^. 

Adult pratae to child ^^l^ ' v >- 
Adult acknowl^dgnent to child 
Adult f^oa.ltive corrective XeeMbacK to child 
Adult negative corrective feedback to child ^ 
All adult Corrective feedback to child 
All child self *initructlon ^ 
thild asVing queati^na of ftdultt 
ChVId- se^f *«xpreailon, A^e/ierft} cotiimenta , 
Adult ihteraction %lth 1 or 2 rhiidren ^ . 
Adult interaction with anal^ group 
Adult Ihteri^tion with large group 
- Adult ^n«gative behavior 
Adyirpoaltlvtf behavior , 
Child negative behavior ^ ^ . * 
Child poa It ive' behavior \ , ^, 
Child initlatea interaction »lth adult 
Child Initial ee Interactidn with other chUd 
Child non-verbal 

Child cooperates with other *childrefl 
Adult to child positive touch " > 
Adiilt to child negative touch* 
Child gives poaljt Lv« touch 
Child gives negative touch 
Adult" helps child - 
Adult fefuaett rejecta'^chlld 
Child refuses^ rejects adult 
Child interacts «lth aachine 
All notion 

All positive bcltpvior 
All jnegative behaVLor \ 
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,6,8324 


.05 


24*;: 
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. 1242 


.050 
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Ac«d^iil£ activltiea / t 
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.4979 


. 36.2313 
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6.9022 


3.0588 


3.8359 
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.oolv: 
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2.864 


84; 6102 
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- ♦OOOO 
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' 3.9097 
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1 2 . 0209 
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♦ 05 - 


30 


^nall groupa 


1.377 
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1.3973 


10.1069 


.01 
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large groups 
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.2155 1 


.71fi7 


*5754 


.4956 
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Claaarooft managepent 
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1«0415 
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.3^60 
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4.8679 
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.3728 - 
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.000 
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^ Hvmber pf framea for thla ctf^a 
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Adult infonalng child 


3.8881 
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3.2883 
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Adult direct re<)ueat to child 


3.0754 
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Chllid reaponae to adult direct re<)ueat 
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Aduit corrective feedback to child reaponae 
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Adult a^^knoirled^Kent to child reaponae 
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.01 




Adult praiae to child reaponae 
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feedback 
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PiU/SprliiB Differences 








; 1 . JSpring - AU 


Activities 






Site 1 


SlU 12 


Ovtrail 


nit to 




P 


SStd 1 


Site 11 


6it« 12 


' Overall 


T Rtt lo 




T Score 


JL 


■ T Score . 


JL 

fiS 


\ l^^cori 

laes 


P 






.-3104 


.2396 


.8451 


,2669 


1.9391 


1 .02 ' 




, . i « 


"ns 


^ ft . , 




2.000 


4.25 


8.00 • 


4.4545 


330. 5455 


.poi 


R 


<. • ■ 


1- 




.30 


KS ' 


►9 -1*4753 


.05 


20,75' 


20.75 


. 18.333 , 


20.0909 


.7063 




1.64 


HS 




NS 


1.547 


NS . 


150.2611 


.001 


.2856 


.0739 


.1251 


.1646 


11.0963 


.01 


3.11 


.01 






.914 


NS . 


2.6105 




.3296 


.i340 


.2387 


»2337 


5.7885 


.05 




n& ■ 


• 2.26 


,10 


.612 


NS 


19.875 


.001 


71656 


.4916 


.1301 

V 

.6936 


,.2745 


4.1864 




1.25 


ik 


.59. 


NS 


.U9 


NS 


■ . : ^ f • 


.001 


.1986 


.6155 


.3216 ' 


8.8704 


.01 


.22 


NC 


. Ji 


^5 


«020 


, NS ■ 


46.2078^ 


'<^1 


.2846 


.7468 


.3368 » 


.466^ 


1^.3578 


.01 


;56 \. 


KS 


1.9? 


NS 


1.484 


NS ; 


?5.0161 


.001 


.5374 


.6654 


'^5d01 


.6710 


5.1811 f 


, .05 




NS 


1 i? 




t'j^.2^57 


»05 


1«9388 




.3014 


.1555 


.3986 


.274'J ■ 


8.5104 ' 


.05 


,15 


ifs 


3.43 


.05 


li55|. 


■ NS V 


6.<ei3 . 


.05 


.1211 


.0494 


.1061 


. 0909 


.4420 




.47 




-^64 


NS 


.063 


NS - ' 


10.6601 


.01 . : 


1.5468 


1.5563 


1.4701 


1 . 52^ 


.0427 


_ _ 


1^56 


Its 




.05 


2.985 


.05 


2.2935 




.3284 


.4261 


.5754 


.4313 


.5338 ^ 




1.41 /, 


)is 


;oo 


NS 


.779 


HS 


25.0423 


.001 


.3093 


1.1769 


.^567 


.6104 


7.9865 


.05 


1.09 


HS 


.31 


NS 


.275 ' 


NS 


6.8324 


.05 


.1651 


.1963 


' .04 99 


.1457 


.9157^ 






MS 


.002 


NS 


.121 




6.1167 


*05 


.0226 " 


.0352 


.0303 


.0293 


.0904 




.87 


MS 


.47 


NS 


.027 


NS 


36^2313 


.001 


. 7265 . . 


.57J9 


.2041 


.0482 


3.4873 


.10 


1.40 1r 


NS 


.77 


NS 


i222 


NS 


179^3364 


.001* 


2.8509 


$.4564 


2 . 80^8 


3.7861 


21.2153 


.001 


2.16 . 


.10 


1.76 


NS 


' 3.048 


.05 ' 


84.^102 


.001* 


1.7987 


3. 7325 


2. 389^3 


"2.663 


8.0632 ^ 


.05 M 


.68 


NS 


iM4 


NS 


1.632 


NS 


3 .9985 


flO 


(1267 


.4984 


.2440 




1.7308 




.21 

* 


NS 


1.78 


KS 


1.361 


NS 


.o« WOT/ 


■ 10. 


.02^6 j 


.0721 


.0000 


.0366 


2.46 




1.69 


Its 






1^52 , 


NS 


■ t A 1 CIO 
w. 01V9 




1.Q272 


1 . 7675 


1.3074 « 


1.3728 


lil42a 


mm 


.35 ' 


ks 


2.05 


MS 


1.451 


- KS 




ill 


1 t 0 f 41 


1 . 5563 


1.4701 


1.6485 


.8282 




.55 


NS 


3.32 


.05 


2.52 


.05 






.4328 


f^261 


.5754 


.4693 { 


.2267/ 




1.58 


NS 


.00 


NS 


1.060 


NS 


' ^ " 76*7173 


.001 


, . 7056 


.8824 ' 


.41^4 


.6913 


ll.d474 


.01 


4.91 


.01 


.98 


NS 


2.678 . 


' .05 " ^^ 


53.2869 


. 001 


.4931 


. 0608 


,0000 


.2014 


87.4646 


.001 , 


2.99 


;o5 


6.23 


.01 


2-287 


.05 


"^4.8679- 


.05 


.'3016 


.0669 




.1414 


6.9475 


.05 


1.75 


NS 


3.53 7 


.05 


3.431 


.01 


^ 12,9088 ; 


»6l 


i3269. 


.0727 


.popo 


.1*53 


2.074 




1.10 


NS 


5.16 


ibi 


2.105 


i 1 




.01 


.0000 


.0125 


.0000. 


.0045 


.8485 




4.38 


.01 


1 




2.421 


.05 


4,4023 


.10 


1173.75 


1234.50 


10^0.33 


1162,1818 


1.0593 




1.70 


NS 


1.49 / 


NS 


1.8«^ 


.1 


' .3*2883 


.10 


4,4707 


4.3826 


^ 2*2856 \ 


3.jfe427 


.4931 . 




.57 


NS 


i 

1.55 


NS 


.812 


■ NS . 


12,0986 


.01 ^ 


4.8161 


i . 54 87 


4.0111 


3.Vo91 


3.5816 


.10 


1.64 


NS 


2.32 


.10 


2.619 


p05 


15.4^66 


f.Ol 


3.6607 


1.50 


^.2017 


2,7498 


2.1976 




2.11 


.10 


2.39 


.10 


3,192 


• 01 * 


. 3.1063 




,2566 


.0125 


.5015 


.2347 


2.1185 




2.30 


.10 


i«2b 


NS 


1.922 


• 1 


- 15.3096 


.01 


.3536 


.0000 


.2629 . 


.2057 


4.5354 


.05 


2.74 


.b5 


.03 


Kj> ■ 


1,763 


NS 


6.1554 


.05 


0643 


.0000 


.4058 


.1340 


1.7599 




■ 


HS 


.67 


NS 


.736 


NS 


It 




■ 10D4 


.0125 


.3855 


.1702 


2.7754 




2.48 


«05 


1.29^^ 


KS . 


1.925. 


.1 


■ .v-.r- ■ 

2*6617 




.0304 


.0000 


.2651 


/ 

i 0834 


1.2978 






NS 


.47 


NS • 


.450 


NS, 
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r*n All Activitt»i 



giU i alii U 



*4« 


AdiiU dlract requMt follOMd by child . 

t^ismi^AtiMm fAliowfld lav odult tirAliA 


•0^46 


.OCKK)' 


ii713 


.0866 


23.043.1 - 


.001. 


.1^61 


»0000 










1,2769 


4 2467 


»3057 


.6374 


36 « 5068 


.001* 


1.2068 


;0H4 


.0974 




, «u 




* • 6256 


4 2467' 


.2705 


.4637 ' 


14.1433 


.01 


,^512 


i0114i 










.1426 


,0000 


.0000 


.0519' 


101.1166 


.001 


,0411 


.oooA 






52 


Adilit pr«i«« to cMld 


.3767 . 


.0000, 


• 6167 


.3051 


23.375 


»001 


.5126 


.01>fl 


.»m 




53 


Adult •cknovledgm^nt to cHld 


• .|4336 


.000 


.3364 


.4500 


3.6453 


MO 


1*0731 


.0000 






54 


Adiflt poiitivo corrective /eedbick to child 


,4630 ^ 


.0000 


.0655 


*1969 - 


13.0^17 


.01' 


1.1426 


*0000 






55 . 


AduU negktive corrective feedb4c> to child 




*0000 


.0000 


.0063 


i6485 : 




,3663 


.0000 


■ .*if$ 




56 


All idTult corrcctlva feedbeck to child 


.6296 


^2342 


id? 14 


.4609 


7.3981 


.05 - 


1.6163 


«0125 . 








All rKl(<f ftA 1 f Rst Iruc't ion * 


- .0964 


.0000 


.0000 ' 


>0358 


2^2999 




.0191 ' 


.0000 






io 


Child Asking queilt ions of sdulte. 


2.8291 


. 1584 * 


.3444 


1,1803 


59<35:$6 


:odv 


2tl267 


.1365 






61 ' 


Child eel f ^expreesi ion , generel coiuier^ts 


12.7575- 


7.1023 


36.6476 


17.9166 


65.596^ 


.001 


17.2707 


14«6464 


26, 7f 




62 


Adult interaction «ith 1 or 2 children 


15.5dl9 


5.9694 


.1.7664 


B.3064 


50.9731 


.001* 


18»6m 


1.4726 






63 


Adult interectlon with sttell group- 


2.8663, 


.0675 


.7825 


1.2883. 


13.2067 


.Ol* 


3.2553 


.1945 


a. nil 




' 64 


Adult interectSon with lirge group 


♦6627 


6.6163 


' ,4.3704 


4.6396 


11.0691 


.01 


9.0770 


4.9612 






65 


Adull negitlve behAvior «. 


.0093 


.2116 


.0000 


.0804 


.9313 




.1091 


.0000 






66 


Adult pOftittye behivLor ^ 


3.7865 


.0000: . 


.0000 


1.3769 


19.9273 


.001 


.4320 


.0000 


ar4Sji 




67 


Child negitlve behevlor \ - : 


.5606 


.03>1 


.000 


.2254 


ll«$249 


.01 


1.6$46 


.0000 


1.3921 




66 


Chtld positive bbhavlor . 


6.3§46 


. 0163 


.6483 


2r4979 


7.5324 


i05 


.9506 , 


.0000 


ao4fa 


69 


Cblld Initiates interAClion with cdult 


10.9253 


>2188 


.4987 


4.1881 


235.^376 


.001 


; 7 .5392 


»^^36 
1.0140 




76 


Child initiates iJ)tor action with other child 


7.344 


4 .5767 


1*9095' 


4 . 7628 


5.5715 


.05* 


.4.6720 






71 


. <aiild non-verbal- ' 


2.0249 


..0593 


.7191 


.9539 


43.0099 


•001 , 


1.1467 


.0000 . 








Child cooperates other children 


.6164 


4.8186 


.0000 ' 


1.9772 


16.b209 


.001* 


.1022 


16.9564 


.O-OOQ; 






'Adult >o child j>ositlve touch 


.0451 


.0000 


.0000 


\0164 


2.2061 




.2240 : 


.0000 


' .oi^lj 




74 


Adult to cblld negative touch . ^ 


.0087^ 


.0105 


.000 


.0070 


.3793 ' 




.0853 


•0000 


.0^10 




7* 


Chll^ gives positive touch 


.0696 


.0000 


.0000 


.0253 


5.8638 


/d5 


.3801 


.0000 


.054if' 




76 


ChlW gives negative touch 


.0317 


.0194 


.0000 


.0186 


. •6973 




.2943 


:oooo 






77 ^ 


Adult help* child «" 


1.7625 


.9723 


.0000 


*9945 


15.8707 . 


.01 


.7657 


.2946 ^ 


.oai>. 




76 


Adult refusef, teiecte child 


'.0205 


.0000 


.0000 


.0075 


'2.5002 




.0467 


.0000 


.CKM>0 




79 , 


Child reLuaes» rejecte adult 


' .0985 ' 


.0597 


.0176 


.0623 


.7451 




.2668 


.0000 


.0^l| 




«o 


Child Interacts »lth machine . 


9.0651 


28.456? 


3^.186 


24.3389 


60.6656 


.001 


7.f331 


45.4924 






61 


All, aotlon 














' 3.1653 


.0000 


4.65^1 


i 


62 


All positive behavior* 


10.6929 


.0183 


1.54^22 


4.3156 


■ 11.385 


.01 


1.4159 


.0000 


31.63! 




, 63 


All negstlvfe behavior 


.8914 


.2815 


.0000 


.4265 


4.737 


.05 


2.1103 . 


.0580 


2;5$l( 





sponsor prediction. 
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BC (O6bClud0d) 



3IU 1 



Spring r All ActlvUUi ; 



T" Scor# 



T 5coff 



\o$e6 


33.0431 


.001 , 


.1561 


,0000 


.XS88; 


.1001 


2.8331 




1.14 


H9 


1.17 


»S 


.300 


»S 




•^6374 


' 36.9088 


.p6i* 


1.2088 


.0114 


.0^74 


.4T03 


5«0637 




,14 




2,61 


.05 


.324 






,4637 


14.1433 ^ 


.01 


.'3>5ia 


.0114 


.0760 


.3344 


4,7755 


.05 


.07 


. KS 


3.4p 


.10 


.356 


' NS • 





178 
84 



»0519 


101 .1166 


.001 


.0471 


.0000 


.0000 


.0171 


1 7!>At 
* . 1 




2 . 69 


.Oj 


t 




1 . 525 


NS 


»3051 


13. 375 ' 




.5126 ' 


0114 


.5266 


.3343 


J . AQA J 




1 . 34 


)iS ^ 


.20 


HS 


♦ 213 


NS 


a C OVfU , 




.Aw 


A . U r J* 




.3209 . 


.4777 




. wl 


4 ft< 
4 1 09 




. 10 


Wp 


" 1 » 73» , 


N5 








A a X%£0 




.3968 


.5237 


A A . A 0 , 


At 


4.43 




A . 99 




« 1 1 V4 


rl 


« 00 63 


.8485 




' . 3663 


. ooop 


.4219 


y2482 


1.9729 




2.07 


. iv 


It 53 


NS 


2.745 


»05 


i460$ 




.<I9 


1«8163 


.0125 


l'.1711 


.9844 


4 . 208 7 


. 10 


1.71 




It 34 




2. 179 


«05 








lUiaA 


. uvw 


^0000 , ^ 


.0044 






1 49 




1 
1 




1 . <9" 


NS 


M • IWJ'3 




. Wl 




■ A Jo 9 


,9351 ^ 


1.0795 


IP . J-i IH 


■ UVA 


• ^ Ai 


.AVI 


0 i ^ 
4 .,1 3 


1 A 
■ 111 










. MVl 


A « • « ru f 

t 




28.75 • 


19.5199 








.05 


. 141 




i 135 


NS / 






001* 




jk .1 r 


7.0566 


9/2344 y 


1^ D . ^ 4 A A 


. A 


4.4? 


4 AU 


1 ■ 99 


ItO 


1.1/47: 


V / 

N? 


1 i 3883 


134 2067 


.01* 


3.1i553' 


. 194 5 


2.1161 


1.8316/ 


7.1735 


.05 


4 a 




J 4 44 




l.vOv. 




4 .'6396 


11.0691 


.01 


3.0770 




3.8133 


'3.3266 


^7250 




\ do 


1 A 
. AU 


. V A ' 






/ 


J 0804 


.9213 




♦ 1091 


.0000 


.3823 


.im 


2.2^24 




1 ^4 

A 4 




14ft 
4 .5 P 


ns 


A 1 f / 


■ • t ^- ■ 
.A 


1.3769 


19.2273 


.001 


.4326 


.0000 


2.1319 ■ 


.6203 ^ 


5.7806 ' 


.05 


4 . ;j3 


.01 


3.26 


.10 


.839 


NS 


.2254 


14 .3249 


. 01 


1. 6846 


.0000 - 


1. 3922 99.23 


3.8211 


.10 


1 . a 




3*90 






.05 


2.4979 


7.5324 . 


.05 


. ,95p6 


.0000 


29.1647* 


8.2997 


103.4359 


.001 


2.5'> 


05 


8.43 


, .61 


y.507 


NS 


4.1884 


23S.8276 


.001 


7.5392 . 


.1636 


i.diM 


3.2143 


87.9151 « 


.001 


3.88 


.0^ 


2.67 


.10 


.604 


NS 


1^.7826 


5.5775 


.05* 


4.6120 


1.0140 


3.665)l^ 


c 2,7945 


20.1675 


.001 


1.87 


MS 


.85 


NS/ 


.837 . 




.9539 ' 


43.0099 


.001 




.0000. 


.2.852» 


1.1950 


10.6753 


■ .01 


2.71 


.05 


3.33 


;iO 


.710 1 


I NS 


1.9772 


16.6209 


.001* 


.1022 


16.9594 


.0060 1 


6.7042 


24.3788 


.001 


1.29 


KS 


I 




i 187 


MS 


,0164 


2.2961 [ 




.2240 


.0000 


.0198 / 


.0869 ■ 


1.0484 


f 


.91 


S6 


1.00 


NS 


.978 


NS 


.0070 


.3733 




.0853 


.0000 


.0380 


.0414 


.>I39 




1.09 


KS 


.1,9V 


NS 


i« 515 


NS 


,0263 


5.8638 


.05 


.3801 


.oooo; 


.0546 


.1531 


3.^024 


. 10 


1.70 


N5 


1 .87 


h$ 


1.684 


NS 


.0186 


.6973 




.2943 - 


.0000 


' .3572 


.2045 


1.4736 




1.18 


MS 


2.34 ' 


.10 


2.276 


.05 


«9945 


15.8707 


.01 


.7057 


.3946 


,0214 


.3914 


5.fi049 


.05 


3.04 


.05, 


i.oo 


NS 


1.321 


HS. 


",0075 


2.5002 




.0467 


.0000 


joooo 


.0170 


.8485 




.34. 




1 




.539 


NS 


*0623 ' 






.2688^ 


.0000 


.0214 


. 1036 


16.6539 


.01 


2.08 


/.lO 


.14 


NS ' 


1.429. 


r NS ; / 


24.3389 


80.9658 


*ooi 


7.4331 


45.4924 


16.7750 


21.8207 


^5.2983 


.001 


1.35 




3.80 


.05 


1.556 


NS 








3.1653 


.0000 


4.8527 


2.4690 


21.3691 


.001* 














, 4.3156 




.01 


1.4159 


.0000 


31.6362 


9.1429 


230.4318 
ft 


.001 


3.36' 


.05 


13. J2 


• 61 


1.149 


NS 


.4266 


4.737 


.05 


2.1103 


.0580 


2.5S28 


1.4847 


4 . 0738 


.10 


It 39 


NS 


3.99 


.05 


2.97 


.05 
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6. 
7 
8 
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n 

12 
13 

16 
IB 
19 
20 

21 
22 
' 23 
?4 
25 
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27 
2S 
30 
31 



VNIVBWltV OF OMCOK (U 



Vtriablei 



AduU/chlld r«U4 

Length ol school d«y * 

Number of 00<>« for cUsi . 

Activity A (snack^ lOnch) 

Activity B (group^i»«,'^*hftrlng» reat; •lory, 
singing; danclnj^) • 

Activity C (numberi, .alphabet, reading, 
lanjtuag© developtoent) 

Activity V (finding out about people 9^^ ho» 
t|iey live; finding Out about the natural *<>rld) 

Act ivUy e (table ganei, gueaalng gaideii 

* *orklng puzzles) . . . ' 

. ■• ."^ 
Activity F (arts, crafts, cooHlng^ lei^inB* 
pounding) • 

Activity G (blocks, trucks, dolls, dress-up, 
«ater playi 

^ctive P\%y ■ ' 

Adult «ith sttall. group - . 

Adult Tilth large groups 

Adult %ith 1 or 2 children In acadenlc 
activities (C and D) 

Adult r;lth aoatl group In academic activities 
Adult' with large group lA academic activities 
-Acadenlc activities . 
Vide variety of ectivvties 
tndepet>dent child activity 
Adult with 1 or 2 children 
Aides* participation in academic activities 
Groups of 1 child ^. 
Snail groups 
Large groups • ' 

• Adults <v It hoiit children:. 



Fall ' All ActtvUles" i 
Site 3 8U» 11 ^ sue 14 Ov<^raU F Ratio 



8.000 
il.O 
.1441 



.1126 

I. 000 

II. 0 
.0642 



.1779 
4. $667 



.1746 , 
4 

17.6364' 



35/33b 
.0752 .0970 



9.042^6. 
Si<l 36 
«^5103 
>4896 



sue i\ 



.01 

.001 

.001 



^0623 
2.750 
23.50 
.0225 



6.006 = 

35.?i9 
.0913 



.3190 


X6q 


',2426, 


.182a 


12.3882 


ioi 


.0313 


.3465 




.5491 


.6631 


.5003 


6.5592 


.05* 


.8977 


.6834 


.0227 


.2350 


.0381 


.1041 


4.4897 


.05 


.0597 


.lH4 , 


.0227 


.0192 


.1341 


.0518 


2.0351 




.0147" 


. 1795 


,0564 


.1303 


.2460 

' ■ 


• .1350 


2.6237 


■ ^« ' 


.0303 • 


.3057 ' 


.0147 


.0000 
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1.3890 
















.596(r 


.2509 


5.2352 


.03 . 


. 9106 


2.^592 


1.7849 


6.4539 




'2.94 


.05 


2.28 


AO' 


2,780 


.0281 


1.0452 


.$980 


48.8308 


.001 


.7298 


3.4309 


9.0803 


101^.8447 ^ 


.001 


7.45 


.01 


6.79 


.or 


2,372 



•<>»V 

.oil: 

.05 

;NS 

■ I 

vs ;v 

N3 

■NS 

■ .05||: 

Ns 

.01 . 

NS '} 

,01 V 

MS : 

NS 
KS 

■NS 
.65 



SITB DlFFfiHCIiCEg tITHm SPONSORS JWJ^ rAlli-SPRIHfi Diri^||i 
USIVtRSlTV'Ofr.kWSAS (UK) -iP 





* Yariibles 






rail • All Actlvltiea 










Spy! hi 






$it« 2 




Site 8 


pveri^U 


P Ratio 


P 


aitt 2 


- iitii 


^% 




AduU/chlJd ratio ^ , 




' .3056 


.,2956 


• 2726 


•1.997 




/1732 


*2175 






Length oir tchool day 


4.25 


6.00 


9.00 ■ , 


6*0833 - 


14.4857 


.01 


'3.25 ' 


6.00 


7.06 


: : . ft; 


Nu»b»r of 009a for cl»ss 


22^?$ 


40.00 


37.50 


33>4167 


'50.6599 


c . .001- 


25.00 


40,00 


38.2 






■ 10653 




.1398 


.1038 


19. 49-99 


.01 


• 1309. 


■i A'tt 

• 143T 


.059 


■- ■ 10 


Activity p (grovptinej eharing,* reit, alory, 


■ ,3051 ' 




,2,988 


.■■ . . y. 
;.3665 








• .^2812 




/v' ■- .. il :' 


l«njuig« d^V^jlopnent) 1 


.4246 


.4500 


'.3392 


.4046 y . 


1.0074 




.4311 


.3937 




: ■ ■ 12 \ 


Activity 0 (finding Out about people i^nd how 
th«y IIV9; finding out about the natural world) 


.i?d5 


/1 1 25 


.0750 : 


.1283 


.5993 




.099-J.' 


.0938 


.039 


, * : V " 13 . 


ActivUy E (table ganoa , gueselng gameaj . 
working pu88le|) ' 


.2395 


' .2000 • 


.0609 ' 


.1668 


7.6033 


.05 


.17W* 


.^375 






Act Wit yT (arts, crafta, cookings Awing, 
pounding) . 


.2831 


.6062 


.1^8' 


.3481 


34,2836 


.001 


.1510 : 


.2500 


\oit 


■'. IS 


Activity G.Cblccki, IruckaVdolla^ dresa^up, 
water play) 


.0702 


.0500 


.0939 


.0713 ? 


.554^ 




.0303 . 


,0375 


\05i 


16 


Active p*l^y . - 


.1654 


.0437 


.0451 


.0914' 


3.5418 


.10 


'>0?6 


.0625 


.065 


: 18 


Adult «ith aniall group , 


2.2533 


2.1812 


i.l7l9 : 


1.8688 


15.5937 


.01 


^,<^9lt 


2,1687 


.934 


f. 19 


Adult i^lth Jarge group 


,3170 


^4000 


.2977 


; .dtj82 . 


1.2641 




r4323 A 


^3612 


\301'i 


20 


Adulfj with V or 2 children in acadenlc 




. 118-7 


.06^9 


'1 05 a 


.2368. 


y ■ 


.0235. 
1.26^6 


*0187 


■ * A Ail 

^02f 


• * . 


iiauii vim aiifi.-i group in academe activitiea 


■ . 1 *2860 


1 »250 , 


*T795 


1.1053 


2*9679 




li4125 


.6H 




Adult with large group ill* acadenlc activities 


fOOO 


, .0062- 


;/.- ' 
4 0204 


»0ll9 


»7967 




.0385. 


,0000 




23 


Academic activities 


- i«1071 


1.2562 


i 7831 


1.0488 


^.3412 




. 1.2358 


; 1^3375 


1 6^ 




Kflde variety of actlvltiea 


2.8040 


2.400 


li574 


2.0193 


7,2753 


,05 


l,731f 


1.8562 




* 25 


independent child activity ^ 


.6525 


.2062 


.7094 


• 58^ 


6.0871:, 


.05 


.6545 


.3937,. 


.00^ 




Adult with 1 or 2 children ^ 


.0104 


.0612 


.0382 


.0433 


3i3762 


Ao 


i0303 . 


.0562 


.02I 


27 • 


Aides' participation In academic activities 


.3937 


iftOOO 


.4997 


, .5978 


J7. 4^257 


.01 


.5670 


• 7437 


,39> 


• •■ ' 28 


Croups of 1 child 


.1395 


.2000 


.2382 


.1926 


.4682 


\ ' " " ~' ' 


*2544 


,1667 


.^3i 


. . 30 


Sma^l groups" 


2^2533 


M812 


1.1781 


1.8709 


15,1947 


.01 


24089 


2<2437^ 




31 


M^^o groups 

Adults without cVildr«n:- 


.3170 


;40oo 


.2977 


*3382 " ^ 


1*2641 


< 


.4586 


.3812 




32 


Classropm (Btnagenent . 


, 1.4>73 


1.9125 


.7240 


1. 3513 - 


10.7276 


^01 


1*5848^ 


1.5250 




33. 


Observing 


.5156 


.3062 


.3107 


.3775 


2.4559 




.5094 


.4312 




• 34 


Out dif the room . 


.4654 


i3500 


. . 5366 


.4507 


5.0549 


.05 


.3615 


.4625 




3S 


^ Other ■ • 


rl088 . 


.1375 


.2810 


.175*^ 


3.445T 


.10 • 


.1182 


.1000 


.3^1 


36 - 


Aiders participation in all activities 


.0000 


.0812 


.0199 


.0337 


6.6199 


.05 


.0000 


.0437 




37 


Number of fr«mes\for this class 


1357.25 


2359.5 


2113.25 


1943.33 


38«4278 


.001 


1436.0 


2378.5 


226i 


40 


Adult inforaiing child 


5.0556 


1.0933 


2.152 


2<7667 


6.4135 


.05 


3.6264 


.9$67 


V 1.18 


. 41 


Aduit direct request to child 


5.7607 


13.3082 


6 136 


8.4942 


57.6309 


.001 


5*0574 


11,^57 


5,18 




Child response to adult direct request 




124 3984 


5.4 >.97 


7.3696 


76.4305 


.001 


3 . 0^53 


•11.3739 


4<26 




Adult corrective feedback to child response 


.6072 


1.2077 


.6504 


«&218 


5.6793 


.05 ^ 


.5126 


1,6569 


.660 


^ : ^ 


Aduit acknowledgment to child response 


.7266 


1.8739 


.0603 


.8869 


14.3218 


.01 


.5489 


i.il76 


.35'9 


45 


Adult praise to child response 


1.75B8 


1.6926 


1.6285 


1.6933 


.0305 




.8211 


2.0996 


.«9| 




Adult direct request followed by child 
respOnsQ followed by adult corrective 
feedback ■ , ' 


.4806 


1.1695 


.4660 


. 7054 


13.7883 


.01» 


.3982 


l'.5506 


,395 


^^>V;\. . 47 : 


Adult direct request followed by child 
response followed by adult acknowledgnent 

9 ■:;■.■•,/■' ■ 


1.3672 


1*6352 


1.3856 . 


1.4627 

■ / 


.1729 




.'6622 


.2.0238 






' •• '\ ■ ^\ 


' / 7S 

















■ii;.;! '■. Appendix t ■ 

, : ■: ■ ■ • • ■ ' ' ' ■ 

^tij^^iictS MltHl^ SPOSSJORS and FALL-SfRINO DliTEREMCES BV SITE 

^)':^r^:i ; i5<mHsnv or Kansas (vk) • : 



14.485* 
15.3855 

1,0074 



f||j4|$9.:::: 
>id.4278 



57.6308 
76,4305 
5,6793 
;14.3218 

13.7883 

ERIC 





SU« 2 




^1732 


-01 . 


3i25 


.001 


25.00 


.01 


• 1309. 



•i.f308S 
.4371 



$iU 4 

.8175 
6.00* ^ 

40.00* 
.1437 ^ 

.2612 

.3937 



.1915 
7.00 
38.25 
.0591 

.3646^ 

.2488 



Over ill F Ratio 



Slt0 2 



SU0 



.1941 
5:4161 
34.4167 
•1113^ 

.3181 
.3599 - 



; .2377 
28.5789 
8.2163 

4.8651 

. > 

.69/9 
8.2852- 



.01 
.01 
.05 



.05 



T Score 

.67. 

.94 

,44 

1.91 ' 

4 ; 

.66 
.19 



NS 

NS 

NS'' 
NS' 

4 " 

NS 



T a core 
1,32 

r 

I 

4.84 , 

.96 

1.57 



IE 
.10 

.01 



Site 8 



T 6core 
3.09 

.44 , 
4.66 /. 



JL 
.03 

N$ 
.01 



NS 1,02' ' KS 
.V^ 2.70 ^ .05 



3.405 

.288 
• 399 

.442 

.99^ 



,05 

NS 

'NS 
NS . 



.5992 

• 




.0994 


.0938 


.0391 


♦0774 


« 2577' 


* 




lis 






»92 


N$ 


/867 


. NS ^ 


r I D^^J J. 

• 


.05 


- ♦ 1733 


> 

r 1375 


.0728 


.1379 


. ^ 
<).3L28 




1.13 


NS 


■ • 

1.19 


K6 


.48 


Ns'^r- 


/-li076 

■ 


, MS - 


34.2836 


.001 


.1510^ 


.2500 


.3662 


.1558 
f 


7.3141 


' .05 


2.62 , 




5.30' ■ 


.01 


2.61 


,0/ 


3.6i4 


.pa 


.5646 . 




.0^3 


- r0375 ^ 


.0515 


.03^^ 


.2530 




.89 


NS' 


.36 


>s 


i.&o 


NS 


1*581 




3.^18 


. ^10 


11076 


.0625 


.0659 


, .0787 : 


. . .4545 




.91 

* 


NS 


.45 . 


NS 


,76 


NS , 


.3M 


' -Nsv. 


18.5937 


.01' 


2.0917 


2.1687 


.9344 


1.7316' 


10.7804 


^.01 


,40 


NS 


^08 


NS 


>.97 


.10 


.530 


" NS \: 


1*2641- 




.4323. ' 


.3612 


.3070 


.3735^/ 


1,5150 




2.28 


.10 


.'2.3 , ' . 


'nS 


.13 ' 




, .839^ 


" NS_ '\' 


>a36it 




.0235 


.0187 « 


.026^, 


' . 022^ 


. .067^ 




1.02 


NS V 


f.48 


NS 


'1.43 ; 




2.093/ 


v05* -"'V^ 


^;9J|79 




1.2656 


1.4125 


.6943 


1.1241 


6.3744 


.05 


,06' ( 


. NS 

a 


l.l^^ 


NS • 


.66 


NS 


.li5 




»7967 




,0385 . 


.0060 


^0126 


.cbi 


.7000 , 


» . - 


J-QO 


NS 


l.QO 


N5 


.53 


NS 


.317 


NS - 


2,3412 




1.2358 


1.3375 


.^945 


1.0892 


4.5464 


• .10 


.40 


, NS 


'43 


NS 


^7 


NS 


.357. 




7,2755* 


.'b5 


1.7314 


1.8562 


1.2576 


i;6i5i • 


15.1774 


.01 


1»31 


■NS ^ 


4,76 


.01 


3.98 


,91 . 


3.563 




6.0871 ' 


.05 


.6545 = 


-.3937 


.90i^8 


/;6514 


3.2820 


.10 


.77 


KS 


,97 . 


NS 


>.67 , 


NS . 


.423 


_NS/ . '{},:, 


3.3762 ^ 


.10 , 


kOSoa 

■J ■ 


.0562 


*0263 

V 


^0376 


.4799 




.84 


NS 


. 58 - 


NS 


.63 


' NS 


,304 


NS A 


17«4257 


.01 


.5670 


.743; 


. .3969 


• 5692 


6*0071 

« 


.05 


2.03 


-.10, 


1.59 


NS 


i.or 


HS 


♦ 308 


NS* -;/- 


,4682 . 




.2544 


.1687 


.3^58 


.35pO 


;i|0383 




.89 


NS 


.29 


HS 


1.12 


NS 


,973 ' I 


, ■ NS '...-^-.> 


is. 1947 


' . .<ii 


3.1089 


2.2437 


.9409 


1*7646 . 


11.4412 


,01" 




NS 


*39 


NS 


1.88 


N^ 


.397 


KS.' " 


; 1.2641 




.4586 ' 


.3812 


.3258 ' 


.3885 


^ 1 . 5088 




3.13 


»05 


.23^ I ' 


NS 


.34 


NS. 


J. 157 


NS 



.or 



.3982 
.'6622 



1.5506 . .3955 
3.0238 .7106 



.7815 
1.1322 



20.1588 
2p''.5408 



.001 

• >' 

.001 



.47 
2.37 



Si 



1.50 



.10 .71 



NS .95 
NS- 2.43 



.01 


1.3848 
. 5094 


1.5250 ■ 
. .4312 


• .4882 
,6205 * 


1.1327 
,5204 


7.2102 
1.2241 


^05 


.08 
.04 


■ ws 


\.80 . 


» 

. NS 
NS 


3.15 


N3 


.879 
. «.017 


* .10 


.05 


.3615 


.4625 


.6890 


^5044 


12.0298 


' .01 


1.86 


• NS 


jf.ss 


NS 


3.06 


.10 


. .926 


NS 


.10 


, 1182 


♦.1000 - 


.3248* 


.isjio 


,7.6578 


ro5 


'13 


. NS ^ 


^^,53^ 


NS 


.81 


N$ 


.101 


NS 


.05 


. 0000 


.0437 


.^476 


.0971 


13.1283 


.01 


I 




,93 


• NS 


4.05 ' 


.01 


1.564 


NS 


.001 ' 


143^.0 


2378.5 ' 


"2205.5 


2006.6667 


9.3064 , 


' .01 


, »2e < 


\ NS 


^ 3,19 


.05 


.79 




.313 


NS 


.o\ 


3.6264' 


.9587 


: 1.1829 


1.9237 


13.0633 


•01 


*,97 


NS 


.58 




1.76 


NS 


1.075. 


' . NS 


.001 


5.0574 


11.967 


5.1826 


7.4023 


'64.2624 




■' 1.04 


NS 


1.35 




3.76 


.05 


.744 


Nd 


.001 . 


3^0353 


il>3739 


4:2666 


6.3253 


117.0226 


.001 


3.44 


.05 


1.05 


NS 


3.66 


.05 ' 


.733 


• 


' ,05 


.5126 


1.55/9^ 


.6603' 


.9099 / 


12.3328 


.01 


.41 


NS 


« 1.29 


NS 


.10 


NS 


,449 


KS 


.01 


.5489 


1.1176 


.3592 


.6752 


3.1264 


.10 


1.03 


NS 


1.41 


NS 


3.08 


.05 


,703 


• 'NS 






2.0996 


.8991 


1.3732 


10.5598 


.01 


2.82 


.05 


.70 




' 3.18 


.10 


1.461 


NS 



NS .355 NS 
.10 1.162 ks 



(Concluded) 



P*n All Activities 



48 

50 
51 



Site Y .StU 4 ; Sltt 8 Overall f Ritlo 



Wul t direcl requoii f ol loned by thUd 
reiponte lbllov«d by adult praire 

Ad^lt' choice request to child 

Chi^d rtfapon^e to adult choice re<iueat 




.7581 14.596$ 
.3d05 a. 0033 
.3306 J.8351 



.Ol*' 



sitt 2 Sir 



.3436 
.6392 
.6136 





vequeat queitlon ' . ' 


.0000/^ 


.ocfoo* 


.0286 


.0095 


361.6645 


;ooi 


.0339 ' 


.0000 




AdyVt.praiae to'child ' 


4-45/ ■ 

/ 

1-3103 ' 


2.5136 * 


2.7089 


3.2242 


>.»694 


.lO* 


3.2415 


3 ; 3935 


' 53 


Adult icfen<>*ledgttent to child * 


2.6423 


.1754 


li3760 


8.5086.. 


■ 'A 

.or 


'l.2171 


1.3511^ 




.Aditlt positive correal ive feedback to child 


1.8219 ' 


1.5888 


.6166 


1.3625 


4.6703 


.05* 


^.0274 


<^^-6$02 


►._55 


Adult negative corrective feedback to child 


.0669 . 


.0127 \ 


.3128 


.1308 


22.6389 


,001 


^^7424 


. .0063 


56 


All adult corrective feedback to child/ 


2.SS4^ ^ 


1.65^6 


1,6334 


1;9490 


1*3728 : 




1.9291 




All child se.3f-inatructidn 


.0000 


.0000 


.0073 


.0024^. 


1.000 




.0439 . 


iOOOO 


: \o 


Child asking queitiona ot edulta ' . 


1.1584 


1.647 


' .9682^^ 


1*9579 


2 ;0386 -^ " 


, ..1 


1»&298 


• .6009 




Chi Id aaif *^)ipre$9loi>» general coionenta 


16*9294 


. Ip.5107 


16.4496 


H.2966 


,13^.0919 ' 


.01 


17.2074 


^ 16.6584 




Adult interaction with 1 or 2*chlldren 


15.0266 


20.569 


14.181 


16.5^89 


8.6595 




18.4709 


l9.05Vii 




Adult interacilon wlthsaalt group 


6.4816 


.2.1866 


,^.0039 


S.5574 


5.8098 


.05 


2.3307 . 


1.8360 


64 


^ Adult intei'action with large group 


3.9532 


3.7612 


' ;. ?23i 


2,8792 


4.1537 


,10 


- 2,0498 


4,4957 


"65 


Adult negative , behavior ' ^ * . 


.0109 


.1655' 


.0661 


.0809 


2*637 




.0000 


„.0441 


66 


Adult positive behavior 


.7404 


>0000 


.0904 
> 


.2770 


2.8795 




.263f. * 


',1634 


67 


Child negative behavior ^ 


.3679 


.2288 


. 2530 ^ 


. 2832 


.7295 




.1S24 


.1263 * ' 


68 


Child jwaitlve behavior 


2.486 


6.9145 


1.32&8 


3.5754 


25.6898 


.001 


1.2269 


^b,6636 


"69 


Child tnitlateS' interaction «lth adult 


2.6145 


1.8376 


2.2439^ 


2.232 ^ 


.1.8918 




2.8603 


,9209 


70 


Ch*lld Initiatea Interaction «lth other child 


3.4133 


1.0431 


5.3942 


3.2835. • 


15.3321 


-01 


2.7675 


,2150 




Chi Id non-verbal ^ 


K5295 


1.5135 


. 2.2971-. 


1.75 


2.873 




1.6816 


.3790 


'72 ; 


Child cooperatea with other children ' 


.1124 


.0000 


.0475 


.0533 


1.0309 , 




,60<J0 


00000 ' 


73 


Adult Co chl2d positive touch 


,0568 


.0000 


.0000 


.01^6 ■ 


1.6424' 




.008^ 


.0000 


; ^ ' 74 ■ 


Adult to chljd negat ive touch 


.0324 


.1.528 


.0073 ^ 


.0642 


3.1287 




;jO0O 


.0378 


-■.-/-;7S"' , 


Child gives p<?tlti*ve touch — 


.2j54 


.0000 


. .0066 


.pj'07 . 


9.8879 


.01 


.016? 


.0000 


76 


Child gives (Negative touch * 


' ,1061 


.1018 


.0148 


.0742 , 


2.4101 




-.0856 


' .;''0443 




Adult. helps child 


1.1351 


<3561 


,9552 


.8154 


6.9433 


.05 


1.3242 


: . 1322 


78 


Adult refuses, rejects child % 


.0000 


,0127 


:,0000 


.0042 


i.oob 




,0000 


:qooo 


70 


Child refuses, rejects adult 


.0000 


.0954 


.1274 

■ / 


.0743 \ 


3.6443 


.10 


.0088 


.01&20 


.80 


Child interacts %llh machine.^ 


13.8734 


11,4375 


18.1139 


14.4789 


8.1631 


' .01 


14.314 


18. '8897 


81 


All »otioi> . 














5.2363. 


.1329 




All positive behavior 


4.559- 


10.0420 


1.4162 • 


5 . 33 8 


48.^349 


.001 


1.5097 


4.92^ 


83 


All negative behavior- 


,4348 


.4198 


.5969 


.4838 ' 


.6101 




.1912 


• *2209 



10 

\% 

m 
m 

.7(5 
.Oil 
.061 

2.21 

xM 



"Sponsor prediction^ 



/77 



ERIC . ' 



AU ActlviUts 



3. 7694 

1.372S 
1.000 

13.09^1» 

»*$09S 
4.1537 

a.«3i , 

.7295 

15.3321 

a,B73; 

1.0309 

3.1^57 
9*S879 

rMox 

/6.903 
1000 
3. Ml? 



,01 

.001 
.10* 
.01* 
.05* 
.001 



^.01 

.or 

.05 

I 

MO 



.OOi 



,01 



.01 
.05 

.10 

*01 



40.5319 



. .001 . 



SHo 2 

.3138; 

.6392 
15136 

.0339 
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5.7717 


\6i 


A .' 


16.443> 


.01 


.4906 


,7695 


.0604 


.4403 


8,4748 


.01 




8.173 , 


.05 


.7430 


,3545 


,0000 


.3658 ^ 


I0i49?7 


• Ql 




24.9974 


.01 


2 » 2637 


2.2637 


.3782 


1.6353 


6.1267 


»05 




.6877 


... ' ■ 


.1508. 


.0266^'; 


-.0000 


. .0591 


1.0648 






12.6439 


.05 


.9565 


1.5421 


.878? 


' 1.1256 


1.0068 


*■<■■ 


,7.0^50 


3.5099 




21.4230 


8.0861 


16.2842 


15.2644 


17.9719 


.001 


11.6035 


17.0895 


.01 


14.9700 


* 13.0152 


7,1842 


11.7231 


13,8122 


.01 


iMU 


11.1385 


.05 


^,7392 


2.8960 


5.0621 


3.5624 


2.9736 




8.49«S 


37.7471 


.aoi 


1.3141' 


5.4928 


10.6699 


5.8256 


7.7775 




.0453 


20.0813 


.oiV 


.3653 


.3963 i 


,0000 # ,3205 


^^^3548 


.061 










1^4249" 


.0151 


.4968 


10,2760 


.01 


; W78N 


38.2634 


.001 


\6488 


,4941 


.0151 


.3860 


7.0591 


.05 




5.3999 


..10 


l>jd40 


3.947.5 


.1460 


^ 1.7325 


69,4807 


.001 


3^1995 


12.8752 


.05* 


3,4*08 


. 6.1589 ' 


1,9495 


3.8397 


15.7769 


« 01 


4*014} 


1.6358 




4.8624 


.6926 


5,6770 


3.7440 


6. 1760 


.05 


i.'wii * 


1,6702 




3.7(96 - 


-4.0784 


1.0824 


^.976*8 


3.2103 


. 10 




1.0559 




.0769 


.0079 . 


.1785 


.0878 


2.4383 


S 


.opijo 


1 


.oOiPO* , 


.0^31 > 


.0000 


.0310 


1.2613 


7.00*9 - 


- .4167 




.1640 


-1337 


.0000 


,0992^ 


lt;>465 






.37-y) ' 




,0000 


.2885 


.0000 


.0962 


6.7935 


.05 




.124.6415 


.001 


.1145' 


.1595 


^ .Q060 


.0913 


2.4446^ 




1^6976 


.9307 , 




• .2430 


.4387 


1.8501 


■ .8439 


8.8685 - 


.01 


.6057 






. opoo 


.0230 


.0000 


,0077 


2,5066 




.0331 


1.0571 




,0293 


.2776 


.0084 


.1051 


4.8588 


.05 


A«0073 


5.1358 


.10 


11.5661 » 


a. 3196 


12.6898 


8.8585 


5,4361 


.05 








4.0736 


7.303^ 


, .4510 1 


_:5bS450 


4.9740^ 


.05* 


1^0895 


.7793 




1.154S 


ft. 7551 


.1611 


2.3569 


37. 5755 


.001 


1,1968 


110.8903 


.001 


1.5516 


2.4959 


.0487 - 


1.3654 


8.5040 


.01 



r»ll/Sprlng plf fer!triC98 



T Score 



T Score * 



T Icq re *p 



1.57 
.58 . 
.68 

.40 
1.25 
2 • 12 
1.19 
2.22 
.73 
1.34 
3.18 
2.57 
1.62 
1.12 
2.46 
5.73 
9,98 
1.13 
6.39. 
2.60 
12.09 
.51 
1.68 
1.12 
3.85 
1.93 
1.95 
1.64 
1<58 
2.10 
3.69 

5.04 
.91 



J/- 



NS/ 

: 

NS 
NS 
.10 

KS ; 
.10 

KS 

.oy, 

.05 
MS* 
HS 
.05 
..01 
.05 
N3 
.01 
.05 
.01 
NS 

'NS I 

f 

NS 
.10 
NS 

\KS 



.01 

N3 




.89 

ia7 

4,19 

.08 

2.79 

.36 

1.00 

I 

.82 

i.99 

4.92 

4,33 

'.44 

2.47 

3.97 

I 

1.36 

.58 
^35 
1^93 

\U 

.86 
I 

I 

I 

.60 
I 
I 

2.85 

1,03%. 
.58 



NS I .096 
NS ,135 
.05 1«180 



KS 
.05 
NS 
NS 

m 

. ' NS 
.01 
. .05 
^ NS 

AOi 

.05 

NS 
.MS, 
K8 
N8 



NS 



.05 



.360 
.326 . 
.930 . 
.461/^ 
1.296 
.333 
,1.435 
3.977 
2,706 
•T87 J 
• 792 
.842^^ 
2.38 
1>779 
.500 
1,797 
1,563 * 
1.688 
.730 
li586 
1.105 

aim. 

1.528 
1.513 
.815 ' 
1.452 
}.655 ^ 
«81i 



KS 
^ HI 

.01 

.03 

' i05 

a 
Ni 

Hi 

f 
KS 

rr 

N6 

HS. 
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■ ' . AppondiJc F . - 

SITE pimftESCES WiTHiN'SPONSOftS AND FALWPRINO DirFEREKCES BV SITE 
\ UKimsITV OF P3TTSBIR0H (UP) ^ 





. Varlflblca 








FdU/Sprlii/ 






tall • All 


Activities 


til f 4 avAMM 




Name 




Activities 


T Score 






AdQU/child ratio ^ . 






♦ 2237 


.606 


NS 


■ ' 7 


Lendfth bX school day 




3 •000 


3,0000 


I 




8 


; iSufflbcr of CQP^i for class 




20,25 


20.0000 

• V i WWW 


.162 


NS 




Actiyity A (snack, lunch^ 




.2441 


'4 

1770 


•1*431 


NS 


10 ' 


Activity B (grouptlmo, sharing, rest, story, 












slnglrtg, dancing) 




.3936 




.060 


NS 


11 


Activity C (numbers, alphabet, readings 






/ * 






language devciopwcnt) 




.2475* 




%.766 


SS 


12 


Activity D (finding out about, peoplp and 








- • 




how they live f finding out 


about tho 










• 


, natural Horld) 


V. - ■ ' ■ . . 


.0580 


/■ ,^549^ 


'3.013 


NS 


13 . 


Activity £ (table gamos, guessing ^ancs, 












>^orking puizlcs) . 




. 1769 


.1541 


*.270 


NS' 


1-1 


Activity <arts, crafts/ cooking, sewing, .. 










• 


. pouncing) ■ 
Activity G (blocks, trucks. 


r 

dolls, drcss^up, 


.2"84& / - 


.3382 


1.214 


NS 


id 












^ w^tcr play) 


.0977 


1 2374 


.3.^613 


.05 


16 ' 


Active play 




■ 0386 




2.651 


.05 


18 


lAdult with smalt group 




1.5fl37 


1 • 4* lis 


1.522 


NS 


/ 19 • 


Adult ulth large group 




5723 


.live 


;467 


NS 


20 


Adult with I or 2 children 


in academic 












,apfl^4tl<<s (C and D) 




.4516* 


1.444() 


,4.051 


.01 


*: 21 : 


Adult nVtt^ ^raall group In academlcactiyillos 
Adult wllh'^^ge group In acadctflc activities > 


.3076 


.0833^' 


.3.011 


.05 


. ^2 ' 


.0477 


.0000 


1.728 


NS 


. 23 


Academic activities • 




.6797 


.8424 


• 870 




' 21 


Wide variety of ac^ivltibs 




118349 


2.^583 


1 <MV1 

■L . STVV 


no 


25 


Independent child ectlvlty 


' /" 


1.2783 ' 


2.4783\ 


1.738 


" NS 


26 


Adult with 1 oi--2 children 




;2779* 


i322B 


.497 


NS 


27 


Aides* parti^ripatlon in academic activities \- 


.i249 


.1478 


.250 ^ 


,NS 


28 


croups of 1 child 


* 

] 


i92ft9 


2.8543 


2.873 


.05 


30 


Small ^5 roups 




1.5664 


. 1.2213 : 


1.619 


NS 


V.31 


Large grouijs ■ 


- ■ * ' i 


.5837 


.4762 


.519 






Adults without children: 
Classroom nanagcffient ^ 












32 




.8217 


.6282 


.995 


NS 


. 33 


Observing 




. 4206 


.4783 


.329 




34 


Out of the room 




.1758 


.1870 


.157 


NS 



o ■ 
ERIC 



f 




,* ■ ■ ' , * i 










5' ' ■' 
1 ■ 




. • ' ^ ■ 

. > UP (Continued) 














- f ' • /■ ■ ■ 






Fall/Spring "\- ' 






' Variables , " . 


Kali - AU 


Spring - All 


Dlf (ercr\ees 








Aet4vltlc» 


'Actlvillc«V 


T SCO re 






35 


• ' * ■ ■ ' , ' 
• Other ' . * , 


.0760 


.0119 




NS * ' ■ 




, 36 


Aide' u 'pair tic Jpat ion ir\ aH festivities 


»O705 


, 0000 , . 


i.opo 




'» ■ 


37 


^ Number «f framop (o^* this class 


U4B;50 


1170.0 




no 




40 


' Adult infomlUK child 


U 9776 


1.9^59 


.OHl ' 


NS 






Adult di rcct request^ to child 


8.'261f) 


4 .0349 


3.667 


,05 




t 

42 


Child response to adult direct request 


0*6302 


3,0827 , 


^ 3,777 ■ 


.01 




.43 


AdulC corrective feedback to e^ild response 


,4783 , ' 


,1 824 


1*450 


• - NS " ' - 




44 


■ Adult .acknowlcdKiflcnt to child response 


1,0527 
2,1673 


*^591 , 
1 ,0137 


' .9li . 


'Jns. , 




4 a 


' ■\\^uli prsSiso' to elilld response. ' 
■ ■ \ ■■ . ' ^ ' - ' " - • ' 
' Amtll direct ixquc^t followed \Sy child- 


*01 




^' 46 








I'. ' - 




rcspon sc Xo n 0 » cd7 ^y^^^^^^ 














. feedback ^ ' 


,3596 


4 1334 


'I.l«)| 


N5 - 




47 


' Adult direct request followed by child 










'p • * 




response followed by adult acknowledgment ^ 


1.8569 


.6177 


3.775 


.01 ■ ' 




48 


- fAdul t' direct request followed by dhlld 














response Xol looted by adult praise ^ ^ 


♦ 7995 


.6160 


1,165 





49 
50 
51 

S3 

34 

55 

56 . 

39 

60 

61 

63 
61 
65 
66 
67 
68 



/Adult c*IWrT(?lf^r«qUCBt to child 

Child response to adUl i choice. request 

Extended child response to adult choice 
request question ^ 

AduU praise to child . V , 

Adult acknowledgment to child 

Adult positive corrective feedback to child 

iK*Ka t Ive cot rec 1 1 ve 



1.6^11 
1.3069 



1,9093 
1.7921 



.a99 

1,176 



NS 
NS 



Adult 



gatlve corrective Iccdback to child 



All adult corrective feedback to child' 
All child sel f- instruction 



CUlld ask ti\g- questions o£ adults 

ChlKJ self-expression, general commer^ts 

Adult Interaction »lth I or 2 chllclrep 

Adult Interaction with small groop - 

Adult Interaction Vilth large group 

Adult negat Ivtv behavior 

Adult positive betlav^ior 

Child negative behavior j 

Child" poslllvc behavior ^ 



.0558 
5,0740 

r : ■ ■ 


.3165 
3.9846 


3.256 \ . 

1,536 . ; 




1.9562 


'2,0356 


.430 


NS . 


1.6582 


,.5213 


3.45 




, 0840 


,0611 


.404 




^.9867 


.8831 : 


2,6i1 


\.05 


Anoo 


2,6124 ! 


3*111 


*05 




1.1766 


1.298 


>S 


12.1804 


15,1291 


1.^25 


NS 


18,435* 


.13. 7pdl 


4.558 


.01 ' 


3.5706* 


2.8954 


1.002 


NS "\ 


6.3106 
.0743 


5.4813 . 
, 0763 ^ 


.601 

.034 ^ 


NS 


.8828* 


2,7437 

# 


4*002 


.01 


.3412 

l*3:i8Q 

■ ■* . 


.3456 

» 

.9.0959 


.029 
^2.074 


- :•■;/ 



O •/ 
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VP (Concluded) 



VartobloB 



No. 

69 

70 

71. 

72 \ 

73 

74 . 

75 

76 

77 

78 

73 

8<y 

8i 

82 
83 



Name 



Child ;lnitiatos.lntor{ictlon with adult 
Child .initiates Intoractlon with other child- 
• Child /lonr verbal 
Child cooperates with other children " ■' ■ 
Adult to child positive touch , 
Adult to chil<l negative touch 
Child gives positive touch 
Child gives negative touch 
Adult helps child . 
Adults refuses, rejects child 
Child refuses, rejects adult 
Child Interacts with machine 
All motion . / 

Ail posit ive. behavior ^ ^ 
All negative behavior 



Sponsor prcdLctioh. 



Foil - All 
Ac ttvi ties 



2.8408* 
2.1960 
3.4166 
.0000 
.0U6 
,0580 
' .0000 
.0000 
1,5887 
.0000 ' 
.1456 
9.6461^ 



. 2.2902 
.4858 



Spring • All 
Activities 



4.5278 

3.8928 

2.3429 

. 0245 

,2198^ 

.0246 . 

.0299 

.0149 

1.4586" 

.0000 

,0720 

10.6323 

1.7695 

5.0B69 

.4465 



Fall/spring , 
T Bcpre P 



4.17! 
4.072 
,2.083 

I. boo 
I46I6 

♦ 734 

1.000 

l.OOp 

.241 

I 

1.035 
.483 




.01 

*0| 

^1 

NS 
N8 
NS 
NS 
NS 
NS.' 

NS 

.01 

NS 



/ 



- o 
^ ERIC 
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■./' 



SITE DIFFKHENCES WITHIN SPONSORS A^O FALL-SPRiN6 DlfFEjRtNCES BY SITE 
, f ^ V ^HfeSPONSIVE ESVlftONMENT CORfX)RATIQN\(REC) 



So. 

6 
7 

10 



Name 



<^duU/chlld ratio * * 

l^ongth ol* school day. 

'Nulubor, of COPs' for class * ^ " 

Activity A (sitack, lunch)* '* ' ^ 

Act Ivlly B' (grouptimG. sharing, rest , story , 
sin^l^ig, dancing) ■ > " 



Fall -All 
Activities 

. 1960 
' 2.000 
22.25 ' 
.2021 * 

,2960 



Spring - All 
Activt ties r 

.21^3 

- 2,0000 , 
, 23.000 
*1618 

.3655 



Fail/spring , 
> /pl j . f crences 
t Sco re 

.513 
I 

•72)fj' 
1.171 

i6/0 • 



11 


Activity C (nufnbors, alphabet, reading, 




1 






language dovcloptncnt)- / 


.3183 


.3210 ' . 


»269^ 


12 


Activity D VfiHd^ng out aboiv^pcviiio and , 
. how they livt-} finding out about the 




\ • 






natural Horld) 


, 1536 


. * lev 


• 110 


13 


Actlv^ity F (table gapies, guos^ttfg gamcs^ 










working puzzles) 7 


»3153 - 


.3333 






Activity F(^rls, crafts, cooking, sowing, 










^ pounding) 


. 2595 


.3021 <^ 


.603 ^ 


15 


Activity G (blocks, trucks, dolls, dress'-up. 








vcatcr play) 

i '■ ; ■ 


. . 1009 


.0331 


1.289* 


16 


Active pi a^ 


.0111 ' 


. 0767 


1 1 893 


18 


. Adult withl siflaU group * 


U 1126 


1,1911 * 


1 « 273. 


19 


Adult vtlth large group * 


.3393 V 


,1160 


V 1.026 


90 


AH II It u'MVi I nr 9 rhilHt'r'>n in ncnriohiiC! y 
' n\M ui(. 4*4^11 ji VI » ^HAAViiiVi* All d^i«uyiiiAw 








21 


activities (C and D) . , ^ 
Adult ulth^snsall group in academic activities 


.2171* 
.1162 


.371/ 
.2879 


.516 
.861 


22 


Adult with Kvge group in academic activities 


.0938 


* .08,71 


<.106 


23 


Acadenvlc activities 


.5110 ^. 


■ .5^52 . 


ai7 


21 


Wide variety Of activities - 


2.05 


' 2.1799 


.365 


2^ 


Independent child activity 


1.7688* 


. 1^«653 


0 

.536 


• 

26 


.^dull with I or 2 children , 


.0667 / 


.0718 


,173 


27 


.Aides' participation in academic activities 


*1558. 


. ,0208 


1.285 


28 
30 


Croups Of I child . ■ 

Small groups . ' ' \ , 


. 6988 
^.6629 


^.9072 
1.2055. 


.621 
2.527 


31 


Large groups 

Adults ulthout children! ' 


,3393 

0 


»ii6b 


1.026 


32 


Classroorn management' 


.6955 


.1631 


1.012 


33 


Observing 


. .4667 


.6187 


1 .602 


31 . 


■ Out of the room ' . 


.3751 


.6018 . 


2.59? 




NS 



\NS 



NS 

as 

NS 
jNS 
NS 
■NS 
NS 
NS 
NS ■ 
.05. 
NS 

HS \ 
NS 
^•05 



REC (Continuedf 



Variables 



35 

36 

37' 

40 

41 

42 

43 

44* 

45 

.46 

47 

48 

4^ 
SO 
51 ' 

52 
53 
54 
55 
56 
59 
60 
61 
62 
63 
64 
65 
66 
67 
68 



Other- ^ 
. Aide's parVl'cipation in oil actlvlticiJ 
Number of fratncs for this cX.ass 

Adult Informing child 

jt _ - , ■ ■ - . ■ 

Adult direct request to child 
Child response to adult dlreet request 
Adult corrective fcec^^^ack to child response 
Adult acknowledgment to child response 
Adult praise to child response. 
Adult direct fequopt followed by child 



response folloHcdJ>y adult corrective/ 
feedback . . ; / 

Adu^t direct rcqncst 'follpwed by cnlTd 
rl?8tx)nse followed by adult ackrWwledgfflcnt 

Adult direct request followed by child 
response followed by adult praise 

Aftult choice request to child 

' Child responsu to adult choice request 

^ Extended child response to adult choice 

request question ^ , 

. . , /" 
Adult praise to child / 

Adult acknowledgment to child *' 

Adult positive corrective feedback to child 

Adult negative corrective feedback to 'child 

All adult corrective feedback to child 

All child self- Ins true tj^pn ' ♦ 

Child asking questions of adults y 

Child self-expression, general cotaaqnts / , 

'Adult interaction with 1 gr 2 ehildren / 

Adult interaction with smal^ group 

Adult interaction with large group 

Adult negative* behavior ' o 

Adult positive behavior \ 

. • ' . . \ . ■ ^ ' 

Child negative behavior 

Child positive behavior . j' 



* 

Fall - All 
Activities 


finr f no » All 

Activities 


Differences 
T Scot-e P 


.3952 


.1648 


1.332 


NS 


• 1070 




.571 


US 






.640 


NS 


1.2676 


1.419^ 


.313 


NS 


9.^322 


8.1991 


.791 


NS . 


1.2624 


6.6735 


.573 




.57671 


/ .8292 


.236 


NS 


: 2,1694 * 


2.9252 


1*101 


NS . 


.4306 / 


\ .2029 


It6i4 





.7191' 

.347^*. 

1.8190* 
.8471- 



.6957 



.1568 

1,9336 
1.7122 



,100/ 



1 /823 



1.934 



NS 
NS. 

NS 

KS 



.^7286 


1.3497 


1.646 


NS 


.0955 


.0935 


.047 


NS 


.6832 


.6438 


. .183 


NS 


2.6977 


3.4596 


1.034 


NS 


1.1523 ' 


1.2068 


^ •141 


NS 


.0115 


.0855 


1.633 


NS 


1.4238 


1.4667 


.093 


KS 


.0000 


.ciooo 


1 




1.3603 


1.6010 


1,263 * 


NS 


14.4922 


13.2533 


.681 


NS 


j5.*015i 


15.840:| 


.33f 


NS 


2.0798* 


2.1239 


.058 


NS 


5.3427 


5.4998 


.Q60 


NS 


.0000 


.0342 . 


^ i.^:.tj 


NS 


.1497 \ 


.1744 


.318 


NS 


.4245 


.3518-1 


.827 


NS 


4^0ZB 


,3308 


V»088 ^ 


NS 



8EC (Concluded) 



Fan/Sprlttg 



69 • Cnild initiat<js inicractton Hlth adult 
70- -.Chljld initiatcsyihloractlon with other chilii 
IX Child nolTJ-vorbaV 



72->^ thild cooperates /wit k^thcr children 

. " - ' ?- • ■ . . 

73 Adult to chrtd positive 'touch . 
V4 Adult tp <5hild negative toUch 



75' ' Child |lvcs pOfc>ttive tou^chj 

7.6 Child ncgatlyd touch 

77' Adult 'helps child * " " 

78 A^.uit ^refuses, rejects child 

^ 70 * Child refu^tkf, rejects adult 

80' Ch4id interacts with machine 

61 - All motidn - • 

/ 82, All positive behavior , . 

85 All\ncgatlve behavior . 



3,1^521 
4.0934 

*,oaoo 

.0250 
.0250 
Jj >3810 
/ .^847 
' . 1759 
, .0130 ' . 
' , ,0585 \ 

' iv.ie47 



.8814 
.5371 



5203 
&5l6 



,c|poo 

.0569 

.1146 

.0570- ^ 

,07^42 

.30p3 

•Olfl 



•;ip.i64 

,4^82 
/84i9 
.4493 



T Score 




> 


1.498 


■ NS"- 


1.898 




1.224 




I 








1,208 ♦ 




.893 




1.410 


NS 


M50 


NS 


,957 / 


V NS 


.,114 


NS 




.0.5 


'",477. 


NS, 






,12b 


■. NS /. 


,,594, ^ 


NS 



^ sponsor pr(;dictlbh. 



V 



.1 



a 
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Appendix G 



• FACTOR SCORE MEAN5 AND STANPARD DEVIATIONS 

FOR PALL AND SPRING BY SPONSOR AND BY ALL HSPV AND HS COMPXrISONS 



ERIC • 



• Tabl<} G-1 (a) — 

FACTOR SCORE mNS AND STANDARD DEVIATIONS 
FOR MLL DATA BY SPONSOR AND BY \\jh HSPV ANd/hs COMPARISONS 

, . , _ ' -y FAcrroR V 



SPONSOR 






2 


3 


'".4 ' 


5 


6 


. ..'7 


FW J ■ . Mean 
N=12 S4Jft. 


.35 

- * • 


.84 
.72 


-.60 
.46 


.23 
' .83 


.87 ^ 
1,89 


.29 

.54 


-.35 
.50 


UA . Mean 
"Ns 8 S.D. , 


.21 


.28 
.38 


-.02 
.35 


-.07 
' '.44 


.25 
.98 


-»82 
.41 


"1 

-.27 
.96 


BC Mea^fi 
N= 7 S.D. 

UO, Mean- 
N=ll S.D. 


-.77 
' .30 


.47 
,57 


-.7.p. 
.30 


-.16 

-^.05 


-.65 
.73 


.34 

^ - • 


. '-.98 
.41 


2 «12 
i .67 


. -1 .18 
.64 


-.64 

.45 


1 .01 
.68 


-.22 

.81. 


-.04 

.36. 


-.42 
1.01 


UK Mean 
N=/12 S.D. 


.93 


■V32 
.65 


.28 
1.02 


-.91 
.27 


-.;0l 


-.06 
' .30 


' -.11 
.41 


HS Mean ' 
^N=12 S.D. 


-.58 
.44 


"-09 
.39 


1.16 
.85 


1.06 
1.81 . 


•* .64 
.74 


-.03 
1.74 


;23 
.72' 


. UF ( Mean ^ 
N=ll S.D. 


- .20 
.44 


-.78 

,64 


-.40 
. .40 


.28 
.94 


-.26 

.160 


-.21 
.80 


.38 


^D 1 Mean 
N= 8 j S.D. 


-.28 fj 
.67 


-.55 
.97 


-.50 
- .45 


.03 
.64 


.02 
.85 


-.25 
.50 


,49 
2.02 


• • 

UP '1 Mean 
N=4! S.D. 


1.11 . 

,20 


.80 

;6i 


.67 
.55 


.59 
.28 


•-.3'6 
.21- 


-.40" 
.06 


.34 
.31 


RE 


r 

/ Mean 
J| S.D.. 


-.18 
•.65 


.69 
.82 


1.49 
.18 


^ -.30 

' .29 


-.60 . 
.22 


-.29 
• .20 


-.53 
.23 


EB 


1 Mean 
f S.D. 


-.68 
.62 


.22 

.136 


.24 
.88 


• .29 
.65 


.07 
• 54^ 


-1.10 


-.63 
.43 


KSPV ; Mean 
N=lbl% S.D.. 


.21 

1.20. 


.01 
.90 


.00 
^ .93 


' .22 
1 .07 


1.01 


r,32 

.87 


-.20 
.91 


. HSNP^ 


Meatl 
L S.D. 


-.27 
.65 


.-.24 
.94 


.06 
\ 1.-24 


.24 
1.17 


-.33 
•71 


.02 
.96 


/38 
1.33U 



b Table 0-1 (b) 



. FOR 



FAplOB.SCORE MBfV^JS AND STANDARD DEVI^ ' 
SPRINGirlA'^f BY SPONSOR AND BY ALL H^PV AND HS COMPAR ISONS 



Factor 



Sponsor 




1 ■ 


' _ 2 


' 3 


■ 4 ' 


■ 5 > 


6 


■ 7 


FW 


Mean 


- .13 


■ .54 . 


- .89 


.01 


.20 


vl8 


- .38 


N=12 

'% 


S.D, 


.52 

! 


- .65 


, .48 


. .48 


1.26 


. . 93 


.50 


UA 


Mean 


-^.14 . 


.41 




.03 


- .36 


- .69 


- .65 


N=: 8 


/ S.D. 


.27 


.'53 


.45, 


.82 


.42 


.35 


.61 


IBC - 


Mean 


~ .32. 


1.23 


- .24. 


-'.12 


1.28 


\. .81 


-J. 53, 


" N= 7 


S.D, 


■ .37 


• .77 


.36^ 


, .59 


1.56 


1.95, 


.52 


UO \ 


■ Moan 


2.18 


' .67 


.'79' 


- .41 


.15 


.45 


- .81 


.N= 8 


S.D. 


.49 


.93 


!.05 


.57 




.33 


.73 


UK 


Meat! 


1.68 


- .12 


' .20 


-1.22 


.OS 


- .14 


- .03 


N=12 , 


*s.b. 


.92 


.03 


.67 


.47. 






.42 

/ _ ■ ■ 


HS 


Mean 


- .58 


.03 


- , ■.30 


.02 


- .34 


• 

r .11 


.01 


N=12 I 


S.D. 


.48 


.77 ' 


.56. 


.38 


.47 


.73 


.38 


UF 


Mean 


- .59 ' 


- .34 




- . 80 


- .33 


- .24 




N= 7 

V 


S.D. 


^ .31 


.34 


.38 


.55 


.77 


.45 


.77 


ED 


Mean 


\- .23 


- .10 


- .16 


- .04 


.37 


- .14 


.64 


N=]12 


S.D. 


.57 


.69 , 


.62 


.47 


1.13 


.39 


1.05 


UP > 


Mean 


• .49 


2.74. 


.25 


;.7i;V 


- .83 


.20 


- ,28 


" N^ 4 


S.D. 

• 


.44 


1.1.5 


.07 


.31 


.31 


.28 


.47. 


1 

RE ' 


Moan 


- .62 


.83 


1.99 


.41 


- , 50 . 


, . o ■ 




N=\4 


S.D. 


.25 




1.06 


* .36 


.48 


.20 


.17 


EE . 


Mean 


- .25 


.47 


.62^ 


- .37 


.21 


.91 


- .28 


N=ll ' 


S.D. 


' .45 


1.28 


.88 


.43 


.76 


2.32 


.70 


HSPV 


\ Mean 


.'16 


.28 


,.00 


- .21 


.05 


.09 


- . 20 


N=91 


's.D.. 


1.06 


i.06 


.91 . 


.*^8 ■ 


,99 


i.ie; 


,75 


HSNPV 


Mean 


-. .38 > 


- .27 


- .08 


- .31 


.13 


.24 


.32 


N=54 


S.D. 


;52 * 


1.00 


.99 , 


.86 


1'.22 


.89 


.97 



; Tabl^ p-2 (ay 



FACTOR SCORE MEANS AKD STANDARD DEVIATIONS FOR; FALL DATA 
. ^ " BY site: 'WITHIN SPONSORS 



SPONSOR 



TACTOR 



1 * 



FW 



« . SITE 


4 ' 


Means 


-^37 


1 .44 


-.64 


' -.59 


-1.05 ) 


' -.36 


-.50 




'i 


c n 
o ,1/ . 




' on 

< . 67 


.23 


_ ; " .22 


.23 


.07 




SITE 


5 


Means 


.30 


.^9 


-.93 


.^7 


.41 . 


.56 


[ ,-.39 




4 


s./d. 


.17 


.37 


.37 

i 


.73- 


.88 


. , .72 


I .76 


SITE 


13 


Means 


-.24 


.1^ 


. -.23 


■ .32 


'3 .24 ' 


-.04 


' ^.15 


■ ^ 


4 


S.D. 


.22 




.46 


,52 


- .64 


.40 


. .07 


UA 












.■' ■ 








SITE 


B 


Means 


-.40* 


r.02 


.27 


f. -.43 


.96 ' 


-.52 


.64 


. . . N= 


. 4 


S.D. 


.04 


.21 


.22 


.28 


.88 


V32 


.22 


site' 


16 


Means \ 


-.52 


.58 


-.32 


.29 


' -.46 , 


-1.13 


-1.19 




4 


S.D. 


.28 


. .24 


.16 


.22 


' .35 . 


,21 


.34 


BC. 




















SITE 




Means 


-.90 




-.58 




-.06 


-.38 


. -1.31 




4 


S.D. 


.21 


.47 


.21 


.16 


.37 


.43' 


' .19 


SITE 


12 


Means 


-^.59. 


.11 


-1.07 


-1.3.6 


-1.42 


1.30 


-.55 


: , N=. • 


3 


S.D. 


.32 


.47 


.11 


.19 


.13 


.15 


.13 



uo 



SITE 
I*= 


3 
4 ■ 


Means ' 
S.D. 


1.36 
, .38' 


-1.65 
.19 


-,84 
.54 


.71 
»26 


.40 
.19 


-.15 
.35 


' .21 
1.38 


SITE 


11 


Means 


2.62 


-1.47 


7.72 


1.76 


-1.28 


.31 


^..07__ 


N= 


4 


S.D. 


.12 


L.16-- 


-—^40- 


"04" 


. .10 


.12 

-.40 
.32 


SITE 
■ ^= 


14 

3 


Means 
S.tJ. 


2 .45 

.44, 


: -.18 
.20 


-.26 
.36 . 


.39 
. .40 


.36 
.12 


-.36 
.11 



UK 



SITE 


2 


Means 


2.20 


.43 


-.10 


-i83 


.06 


> 

-.23 


-.11 


N- 


4 


S.D. 


•94V 


.43 


.M 


.38 


.38 


.20 


.31 


SITE 


4 


Means 


2 .46 / 


.98 


1.52 


-1.05 


.09 


.24 


.30 




4 


S.D. 


.92 ^ 


.24 


.64 


.16 


.43 


.28 


.22 


SITE 


8, 


Means 


1.30 


-.44 


-.55 


-.86 


-.20 


-.19 


-.631 




4 


S.D. 


.31 


.07 


.10 


.13 


.0^8 


.14 


.13 



Table 0*2 (a). (doncluded) 



PACTOR SCORE MEAnS AKi5\ STANDARD DEVIAtlpNS FOR FALL DAfA 



BY SItE WITHIN SPONSORS 



FACTOR- 



- tsPONSOR 




1 


2 • 




4 . . 


5 


/ .6;-. ■ . . -, 


. 7.. . 


HS 

SITE 


2 
4 


Means 


-.12 

AO 


-.31 

^ •Pl 


.23 
.27 


3.48 
.85 


.65 
.27 


' 2.09 
1 .44 


,70 
.95 . 


Ol i Ci 


6 
4 


Means 
S.D. 


-.78 
-13 


.07 

' ' .32 


1.21 

' ,28 


-,34 
.3& 


.79 

1 1? 


-1.22 


.16. 

• 1 fi 


SITE 


10 
4 


Means . 
s.b. ^ 


-.84 
.30 


-.02 
,16 


2.04 

.63 

> ■ ■ 


.04 
,33 


.50 
,51 


-.97 . 

_.24 


-.25 " 
. .28 


UF 




Meaas 
S.D, ^ ^ 


• ^ ^ 


-.10 
.28 


-.6? 


-.28 


> .» ' 


-1.05 

• HO 


•12. 

. •*>^ '\ 


SITE i 




Means 
S.D* i 


-^.36 
.31 


-1.53 
.06 


— .30 
. 17 


1.45 

.34 . 


-.11 


.08^ * 
.14 » 


.08 
.18" 


SITE V 


<l0^3i^atis 
4 S.D, 


--35 
.38 


-.53/ 
>.32 ' 


-.35 
.50 


-.49' 

.28 


-.50 
.41 


.13 
'.31 


-.02, 
' . 62 


ED 

SITE 


5/ 
1 . 


Means . 
S.D. 


-.32 
0.00' 


1.21 
vO.OO 


-.16 
0.00 


0.00 


i .44 
0.00 


-1.50 • 
0.00 . 


-.52 
0.60 


$ITE . 


6 
4 


Means 
S.D. 


-•87 
.22 


-1.43 
.30 


-.44 
.58 


1.57 : 

.15 


,39 

.27 


-.08 
.11 


-.98 
.72 


SITE 

• Ns= 


8 
3 


Means 
S.D. 


.51 
.26 


.03 
.05 


-.68 
.12 


.69 
.29 


-.96 
.00 


-.07 . 
,25 


2.78 
1 .31 


UP 

SITE 


.3 
' 4 


Means 
S.D. 


4 

111 

.20 


.61 


.56. 


.28 


- .do 

.'21 


— — — 

- .40 
.06 


/ 

,34 
.31 


BE 

SITE 
N= 


1 

4 


*'■ . ■* 

Means ^ 
S.D. ' . 


-.18 

,65 


.69 
.82 


i^49 


-,30 
.29 

i 


-.60 

.22 


-.29 
.20' - 


-.53 
",23 


EB 

SITE 

N= . 

SITE 


3 
4 

4 

■ 4 


Meanp 
S.D. 

. Means 
S.D. 


-.58 
.10 

-.03 • 
.30 


.80 
.36 

-.30 " 
.27 


-.54 
.38 

1.23 
.72 


.88 
.65 

-.14 
,39 


y65 

.39 

-.07- 
.12 


-1.61 

-.59 
•28 . 


-.77 
.35* 

-.37 
V ,38 


SITE 


5 
4 


Means - 
S.D, 


-1.43 
.24 


.15 
.38 


.02 

.io 


.14 
• 36 


-.36 
.39 


-1.12 
.31 . 


-.75 
.43 , 
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Table 0-2 (b) 

• ^ ■ . ■ •■. ■ ■ ■ ■ ' » 

•FACtpR. SCORE MEAN§ AND STANDARD D'EVIATIONS FOR SPRING DATA 
\, ^ BY SITE WITHIN SPONSORS ^ . 



SPONSOR 



FACTOR 



5 



6 



FW 



UA 



/ 



BC 



UO 



UK- 



SITE 


4 


Means 


-.40 


.90 




.4. 


S.D. 


• O 1 


.57 


SITE 


5 


Means 


,44 


.69 


N= 


4 


S,D, 


.24 


.39 


-SITE 




Means 


-.36 


.09 




4 ; 


S.D. 


,28 • 


.39 


SITE 


8 


Means 


. ■ .'■ , 
. -.11 " ' 


.10 


• N= 


4 


S.D. 


.25 - 


.48 


SITE 


16 


Means 


-.18 


.73 




4/ S 


,29 


- .37 








* ■ " * 




SITE 


I 


Means 


-.35 


1.03 


• N- 


4 


S.D, 


,37 


^ .39 


SITE 


12 


Means 


-,29 


1 .49 




3 


S.D. 


'. .37 


1.02. 


SITE 


11 


Means 


2,08 


-1 .56 




;4 


S ,D. 


.53 


.30 


SITE- 


14- 


Means- 


— 2t27 


— -2r 




4 


'S<p. 


.42 


.30 




.07 
.23 

-.66 
.30 



1.60 
.90 



l^TUl 
.30 



-.35 

as 

.33 
.27' 

-.04 
■ .28 



■'.47 
•41 
.53 



.14 
.17 



-;95 
.13 



-.79 
.22 

1.59 
1.12 

^-.13 
.47 



-«20 
' .40 

7,53 
' .36. 



. .38 
.16 

1 .12 

,22 

-.98 

.is 



-.47 
.2? 

•-.91 
.26 



-.20 


.30 • 


1.10 


-.86 


^28 


.40 


1.68 


.18 


-.30 • 


^.68 


1.51 


3.0^ 


,.4-4 , 


.24 


i.34 


.50 



■;5i 

.38 



.73 

.22 



.81 
.39 



.16 
.09 



SITE 


' 2 


Means 


1.76 


.23 


-.17 - 


-1.15 


-.06 


■^,65 


N= ' 


4 


S .D. 


.51 


.41 


.25 


^ .59 


.22 


,21 


SITE 


4 


Means 


2,63 • 


.28 


.98 


-1 .58 


-.34 


.30 


n- ■ 


-4, 


S.D. 


.31, 


.20 


.59 


.29 


■12 . 


.12 


SITE 


8 


Means 


.65 


-.87 


-.19 


-.93 


153 


-.06 




4 


S.D. 


.45 


.37 


,19 


.13 


,45 


.21 



Tabl^ G-2 (b) (ConclDded) 



FACTOR SCORE ^tEANS AND STANDARR DEVIATIONS FOR SPRING DATA 
• ^ ' BY SITE WITHIN sponsors' 



FACTPR 



SPONSOR' 



•HS 



UF 



ED 



SITE 


2 


• 

Means. 


-1 ,04 


-.28 


-.78 


-.32 


'ig - 
-.10 


.81 


.33 


^ = 


4 


S.D. ' 




,11 


.20 


.42 


.52 


.36 


.23 


SITE 


6 


Moans 


-,57 


1 ,01 


.31 




- ,75 


- 27 


.02 




4 


S.D.. 


,42 


,38 


,40 


.22 • 


«.22. 


.16 


' !o7 


§lfE 


10 


Moans 


-rii 


-.65 - 


-,44 


.08 


-.17 


- 86 


- . 32 


N=: 


4 


S.D, 


' ,22 


7 ,29 


,34 


.1.1 


.32 


.15 


.41 


SITfe 


2 


Means 


-,37 


-,06 


-,32 




- -.02 


-.70 


• . -.03 




3* 


S>D. . 


.36 


.25 


.50 ' 


.10 


.87 


.22 


.38 


SITE 


10 


Me.ans 


.-.76 


' . -.56 


-:49 . 


-1.16 


. -.56 


.11 


-.27 




4. 


S.D. 


.10 


•,21 


.24 


.46 


.57 


.19 


.95 


SITE 


* 5 


Means 


^-,59 


,-.15 . 


.22 - 


-.54 . 


.85 


-.22 


-.50 




. 4 


S.D. ' 


,56 


. .72 


.34 


• .41 




,17 


,43 


SITE 




Means 


-,22 


" .-.63 


.20 


.18 


1.28 


-.05 


.60 


N= . 


4 


S.D. 


.26 


.'l'& 


.20 


.-28 


.36 


.58 


.34 


SITE 


8 


Means 


.12 


747 


-.91 \ 


.23 


-1.02 


-.15 


1*91 




4 


S.D, % 


.60 


.63 


.40 


.20 


' .16 


.28 


. . .54 



UP 
" SITE 



3 Means 

4 S.D. 



.49 

' .44 



2.74 
1.15 



.25 
.07 



1 .71 
.31 



-.83 
.31 



.20 
.28 



-.28 
. .47 



RE 



SITE 



1 Means 
4 S.D. 



-.62 
. .25 



.83 
.69 



1,99 
a .06 



,36 



-.50 
s48 



.37 
.-20 



-.45 
.17 



ED "r^^'^'^j- 
si\e K 

SITE 
SITE 



3 
4 

4 
4 

5 
3 



Means 
S.D. 

•Means 
S.D. 

Means 
S.D, 



-.41 
,05 

.17 
.45 

-.62 
.25 



1.99 
• .66 

-.75 
.16 

.05' 
.43 



-.32^ 
.39 

.47 
.17 

1.70 
.50 



-.87 
.24 

-.18 
.15 

.04 
.15. 



.18 
.'51 

-.45 
.29 

1.14 
.43 



3.94 
,.i8 

-,47 
.18 

-1.28 
.21 



-.13 
1.01 

-.59 
.33 

•-.07 
• 2o 
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V Appendix H V t/ 

RESULTS OF MyLTIVARlATE REGRESSIOK AN^ 

^ AND HVPOTHESIS TESTING . 



201 /o><;jt 



ERjC 



Introduction . ■{ \, • . 

The reader will note that certalrtjlbertles h^ve'been taken In th^ manner * 
with which the regul^s of the muUlVarlatiB mQdel analyses sre repdried} however, 
it should be^mphaslz^ of a highly exploratory nature. 

The analyUdal IntenUon waslto to accept or reject hypothaseSr but to 

uncover and display any relationsntps-jor tendencies that th^ data may" contain* 
Strictly speaking, If a hyppthasfs^test fallil^ to reject nuU at a gross lev^l, 
subsequeftt finer levels should not li& subjedtedto ahalyses. In the program used 
In this analysis, however, aft specif Ip^d hypothesis levels a ro tested In each 
computer run. The deiclsldn was made to report all findings Indicative ol a re- 
lationship wt^erever they appear. Also, without entering Into a discourse on 
the trade off risks between alpha and beta errori^^ we are repforllhg hypotheses 
tests, significant at the 0,10 level. r * 

MODEL I; Effect of Demographic Covariables on Test Results 



Mean classroom scores on the 17 demograph. 
d^crlbed In Chapter II were subjected to multlva 

classroom: mean scores on the four outcome measures as dependent variables. 
The results of this analysis are shown below. 



ic and prertest covariables 
rlate regress loh'analyals on 



(1) Proportlori of test vai^lance accounted for by the 17 covariables^R^): 

Test . ' Percent Variance 

3- D " ' .794 / 

4- A . .747^ \ . 
PSI ' ..804 — 
Stanford BInet (SB) ^494 * 

(2) Tests of hypotheses (stated In terms of the null hypotheses and their ' 
^ levels of ^ejection), . . 

(a) Hypothesis 1; That the covariables as a unit have no effect on the 
test scores as a unIt.J 
■ ' • • ' > , '• ■ ' ■ ■ .. / ^ ■ , ■ " - 

N - 10b classi-ooms 
' df = 68/afl2' 
I F = 6.52 
p < .001 

(b) Hypotheses^ja ^ 18i That each of the covariables considered 
separately have np effect on the test scores as a unit. 

- 'f » » ' * . 

*N "^XRTcIassroomiS 

df - 4/79 ' * / 

. . . . • \ ' ■ V 



Covarlable : , ' ^ 

* r. Number chJlcTr'eni/fn elass^ both fall 

and spring ; : ^ 

2, Mean age In monthfe ^^ 

3. Percent female- 

A. Percent having pi^evlous preschool 

5. Percent having English as first language ; 

6. Percent noh-\vhl^te > 

. 7. Mean olze of household ' i 

8. Mean Income 

9, Mean mother's education In years 
10. 3-p total* pi*e-rscore ^ 
1J» 4-A total pr§-score 
12/ PSI tot^il prersco're ' 

13. Stanford Binet (Plnne^u scoring) pre-sc<ire 

14. Percent read to at ho/xie 

15. Number vaird pre and post 3D > 

16. Number yalld pre and' post 4A 



17, Number vall^ pre and pqst PS'l 



A' 







" P< 






■"' ■■■■■ , * ' 






, .001 




If 08 






3". 82 


.01 




3.16 


• .0'5 




4.09 


.01 




1.41 


NS' 




/ 0.83 


■ NS : 




. 4.49 


.01 




3.45 


.05 


i 


1.58 


NS 




14,09 


/OOl 




2.35 








MO 




' 0.65 


■NS; 




0:79 


NS 




' 1.77 


Ns' V 



(c) Hypotheses 19 -86; That each of ihe covar tables constdek-ed 
separately, affect each of the test outcomes considered separately. 

\N = 100 classrooms v 
df =1/82 



a 



w - — 



00 

a 



V 

a 



Q 

CO 



O 



10 

o 



H 



CO 



M 



g g g t S. g g o -; g g g g I 



I I 



I I 



00 



H'* I I I 



\ o 



r-l O H O ^ O O 



g g ' 



irt CO 



> P. ^. *n - 
» ' t- (M CO M »r5 \ ! 



^ H Irt 

.O $ :0 O 



o o 



fH 

00 



CM CM 
in b- 



CO CO 



CO 
00 



CO ♦ 



t I 



s 

.8 

u 

O 00 
O ^ 



•« II 
55 T3 



o 

o 
O 




CsJ CO ^ tO l> 00. ^ O ?H M 



M CO 



in <^ 

H H H 



205 



MX)DEL 11; Effect of Tnhplementatlon Variables on Test Results . . - , 

— _ , .V ' ' ^ — c < ; ■■ ■ . . . — :■ - 

Ih'^lftls MODELS class rooirf mean frequejlQles on the 24 Implementation 
variables were added to the covarlables 6sed in MODEL I and subjected to 
multivariate analysis with classroom mo^ins'pn the four outcomes r The^^^^^^ 
Ave as ifollowsi i * , ; V 

* \ I • ^ ■ ., . . • . \ ■ . .■ : v: - ^ ■■■■ : , r-"'/]- ^;J:^ 

. : (I) Proportion of . test ^core varlaricfe accounted for by all variables (R^ 

/ |rest V . • . Percent VarlaYice 

• / 14A . . > .885 ' 

^ psi I ^ / * ^ •oie . : ; 

- ■• SB' - — '—^"^^ : - .744. ' • ' - ' ^ 

;^(2) Tests of Hypotheses In terms of the null hypo^hes^s and ; 
therr levels of rejection). ' . ' \ . • 



4 



. ' ^ (a) Hypofhedis 1; That the covarlables as a ynit have na effect on , 

tgst soorVs as a dnlt. / ' ' • . ' V;"^ 

; : ' V N = 80 classrooms ' ' ' V-'^ 

\ df '^ ,68/340 : . ' i .t;:^^ V 

< .-001: -v ^.■/."^"^ 

V- ^ . "v-^- ■■■■ -7 ^ 

(b) Hypothesis 2: That the Irtiplementatlon variables as a unlt haye 

: . ^ no; effect on the test scores as a unit. ' ; ' 



\N 80 classrooms' • 
^f ==967141- \ 
^ - 1.33 ■ - 



(6) Hypotheses 3 -'|9; yThat the covarlables cdnsfdered separately 
have no effect on the tfest scored as a unit. ^ \' 



I 

II:--; 



Covarjabtes 



1, Number oKtldfen In classroom present^bbth f^ll 
and spring • v . ' 

2» Mean age In niontbs ^ . V , 

3. Percent female ^ \ 

4* Percent having previous t)reschool . * 

5; Percent having English as first langqaj^^^ 

6, Percent non-white 

7. Mean^slze of household 



r 



8, Mean^ IncomS ^ ~ -i*' 

9,. Mean mother^s education in years '/^ 

1 0 . 3 -^D to ta I p r e - sc o re 

11/ 4-A total pre-scow 

12; PSI total pre-scorQ / V ' ^ * 

13. Stanford Blnet (Pln^au scoring) pre-score, 

14. ^>Percent read to at-hdmb\ . 

15. Number valid pre ^rid .post 3D 

16; Number valid pr6 and post 4A i / 
lit^ Nuniber valid pre^^^^a^^ . 



(d). Hypothesel^O - 43 : : That the ImplemenU^^^ 
• considered separately have np.^ffect o^ the^te^^ $L 
■ unit*-- - :^ ■ .-■ '■^'I ' ■ \- -r^"' ■ 











p< 


- 




' v NS 


. : 


> 3.27 








NS 




3 ♦21 


,05 






















■ :.: . ■ ^ 






3.56 






2.28 








'M- - 
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•.3.98 






2.31 ■ 














Mg" 




■ f ■ . " ' ■ 
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207 



Implementation yaif.lables > 



6. v^uit/chlld ratio " v ^ ^ ; • ' ' ^ . 5 ^ 

lOV Group time, sharing, rest, itpry, etc* • 4 

!!• Numbers. •alphabet, reading 

13. Games ^ puz^ea ; ; , > f " - : 

20. ]/(iu|t with ono or two children, acaidewlo kcVlvlty 

2i;-AduU with smiall group^ academic activity f 

24^ Wide range of activities^ • V 

25. Independent ohllcj actlyny ^ • K 

"46i Adult wlth,one or t>jyo cl](|Wren . / 

46. ^^ttlt direct qu adult -^^ 

. . 'corrective feedback ' . \ ^ ^ 

•47. Adult direct question* child response, adults . 

^^kpowledgement^^-- . } \ 

18.' Adult (Jlrect question, child response, adult " 

. praise""'-^ 

4 49* Adult open-tended ijuestlon, J: . j' j / 

52. ^AduU praise to ch^ r 

53. i^gftlt acki^owVe^^ ' . ■ 

54. IWuU 

59. . V' . • : 

62. Adult Interaction with one or two children 

63. Adult Interaction viith small group ; . ^ 

69. Child initiates Interactlon'wlth adult 

70. Child Initiates Interaction with other children 

71. Child non^ Verbal a ' 
— - 72. - /Cliild cooperates yylth o 

81, j|Tl" motion " 



2.43 



.2'. 3 5 



P< 



,NS 
NS- 
NS 
NS 
NS 

,1 
NS 
NS 
NS 
NS^ 

NS 

NS 

;'NS 
NS 
NS' 
NS 

^S 
NS 

.1 

NS 
NS 
NS 



NS 



* (e) Hyfotheseg 44 *''104s that the covarlables considered separately 
, havptno effect on the test SQpres cons Idefed, separately. V V" 

^ * / • N r 80.cl^srooms 

" \" ■ ydf^'y yss. ;>,;..■;._; ^' '^ V;. • ' 

-(f) ^ Hypotheses 105 ^ 200; That jhe Implementjatlbn variables const*- ^ 
- d^red separately have no crffect ori the test results considered 
V/ se{5arately. I ' 



* N 80 clae^rboms 
\\ df - 1/38 V 
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RfODEL in: Effect of Other Process Variables oh test ftesuUs 



. In this MODEL the classrbom scores on^ntne additional process variables 
thought to af|ect children's test perfoimancea^Wj^re added to the covarlables 
used In MdBEL I and the implementation variables used In MODfiL 11, and all f 
were subjected to multivariate; analysis with ihia clafisrootn tnpan Rost scores | 
on thejou^r tests as dependent variables* The results'are 6s follows: / 

■'■ . . ' ■ . . ■ ■ ■ ' ' ^ ■.. f ■ - . , * ' . ' . H 

(1) Proportion of test aco,re variance accounted for by all variables (I|2)\ 
Test Percent^Varlance 



3D 
4 A 
PSI 
SB 



: .898 
^ .946 
• 824 



(2) Hypothesls\fests (stated In terms of the null hypotheses and their 
levels of rej^tton). . . ■■'^^'f' y 

(a) Hypothesis 11 That the^covarlables as a unit set ha^e nd effect 1^^^ 
on the test scores as a'^urilt, - // \ 

. . , , V N = 80 classrooms 

df •= 68/104 

■ P = .001 

(b) Hypothesis 2; That the Iih[)lementatl6n. variables as a unit have 





no effect "on the test scores as a unit. 

N = 80 classrooms 

df ='96/106 

F = 0.886 

f> = NS 



4 



(c) Hypothesis 3; That the additional process variables as a iinlt have 
, no effect on the test scores as a yhlt. ^ , y • 

. N = 80 class roojirts ' ^ 

r df = 36/99 . ^ ' 

F = 1.16 , 

p ■= NS. -/J ■ ' ■ 

(d) Hyp<>theses 4 r 20; That the covarlables considered separately 



have np ef^eoi oil the te|t scores as a unit. 

N >= 80 classrooVns 
df = 4/26* \ 



Hypotheses 4 - 20 

N = SO / ~. 



i 



Covarlable \ 

. — — • — ^ — — — - 






^» Number children In clasFropm present both fall 




NS 


and spring \ 






2. Mean age In months ' V ' 


2.20 


.1 


3. Percent female — t 




NS 


4p Percent having previous preschool V 


' ; -5.05 


..01 


5, Percent haying English ias first language , - \ 




NS . 


6#. Percent .non-whitiSi 


t 


• NS 


7. Mean 9ize of household 




NS 


^- 8, Me&n Income 




NS 


lVte^n^pc\other's education in ye^ars \ / 


' 3.68, 


.05 


i&rD total pre-scbre 


2.2 V 




ll;-4'^ total pre-score > ; v 




r.: NS ' 


12^ PSl*tot4l pJ^ci-.Score A * V \ 




OS 


13i Stanford BInet (PlnW^^ 


2.80 


: .05. 


14, Percent read to jit hpm / 




'■u - NS 


15; Number vali^ pro and posi |$P V ^ 




NS 


16. Number valid pre and post 4A ^ 




NS 


17. 'Number Valid pre Arid post PS I 




NS' 



ERIC 



(e) Hypotheses 21 -- 44; That the Implementation variables cohsi- 
dered separately h,^e iK> effect on the test scores as a unit. 

N = 80"^ lass rooms ' 

— . -^r^?/2B^' r— ^ — 



212. 







Implementation 'Varlables^;' 


; F 


P < 


. — ■■ ■ . 

6 Adult/child ratio . - . 




NS . :• 


irt rimiirt fitrtA flhftflncrV rest* stbrVi etoi 






11 .Mumbers alohabot. rdftdltiiof ^ 




' - NS, ; 






NS 


sih AHiitt with ori^^ chlldTen. academic activity , 




. NS v 


(>l AVlnlf tiilfVi ftrnfiH c^rAiih^ ac^di^Tillc actlvltv 


*** ^ 


NS ; 


2^4« Wide Tang6 of acllvities 




NS 


25, Itidependent child activity , 




NS 


26. Adult with otte or two chl Idren ' v 




NS 


46. ! Adult direct question, child response, adult 




.NS; 


corrective feedback 






47, Adult direct (juestlon/ child response, adult ^ 


2.37 


.10 


acknowledgment . ^ ^ • 






4811 Adult direct question, child response, adult 




NS 


- ■ oralse * /• . ' ■ ^ ' .'^y.^ 






49. Adult open^hded question . ^ 


2.88 

• ' . - 


.05 


Artnlt: nrAi^e to child ^ 




NS 






NS 


f(4 Adult bo^ltlve coi*Ve6tlve feedback 




' NS 


59, Ail chiid self-i^istructlort 




NS 


62i Adult ihteractlbn with one or two children v 




' NS 


63i Adult Interaction with s^ grpup 7 / - 




.NS 


69 Child inUiates Interaction with adult 

70. Child initiates' tnteractlon with other chUdr^n . 




NS 




NS . 


71. Child nonVverbal^,. — ___„__- — - - 


. . 


- — ^NS** 


72. Child cooperates with Other children 




NS 


81. All motion\ 




NS 



■ :v' T.; I" 



7 



ERIC 



218 



(f) * ' Hypotheses 45 63^ That the additional );iro.ces$ variables 
conswered separately have no eiffeot on the test scores as 

' a.imltr", • . 



N 80 classrooms / 
df -4/26 : : ^ / 



Additional Process Variables 



14. Activity F (arts, crafts/ . cooking, sewing,/ pounding, 

or sawing) . / ' 

\ ■- . > ' . ■ , / , . . ^ 

23. Academic activity 'groupings V • / 

' 27^ Aide's participation in academic activities y 
50. /esporise'^o adult choice 



60. |phlld asking question of adults. v : 

61. Child self expression, general cot^nilnts 
80. Child Interacts with machine ^ / . 
82; All positive behavior / 

83. All negative behavior / - 



2.19 



/ 

P< 



NS .. 

..Ks: 

■ NS 
.X 

NS 

NS. 

Ks 

NS, 
NS 



(g) Hypotheses 54 "Vij^? That the coyarlables considered separately 
have no effect on lHfet» tfest . results separately. 

- . ^n/I'^.SO class roonis . : ^ 

^ ^ 1/29 ■ ^ 

(h) Hypotheses ;l 15 - 210; That the Implementation variables ' 
conside red, is e pa rate ly have no effect on the test results considered 
separately. ' ' .* 

! K = 80 classroomis . ' 

- • - - — — df-=^l/29 .' " 



(I) Hypotheses 211 - 246; -That the additional process variables' 

considered separately have no effect on the test results considered 
- se'lpatately. . ■ - • - ^ ' • ' - ,■■ • 

■ 'N > 80 classrooms • , 
.' <i =.1/29 / , . • ' 



■• / 
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MODEI^ I, ll>4and III Reruns ^ " ' . 

The forefeping data were presented so that the reader could ^atn some 
, Insight into thiS rel^itlonshlps between the variables analyzed arri the Stanford 
BInet Itltelllgence Test, It is obvious however that retention of tKe Stanford 
BInet scores In the analysIs^ greatly rbstricted the sample slzS because the 
test was not given In rhany of the classrooins; and the analysis technique em- 
ployed could not be us^d with nilsising data* 

i ' - • ... - . > . - 

Having fulfilled what wais felt to bei an obligation to not Ignore the Intelll-^ 
gencfe test relationships by presentinjg results from 8() c las sijooms above, the 
decision was made to dirop the Stanford Blnet scores from further analysis, 
thereby increasing the sample size to 121 classrooms. At the same tlme,vso 
as to galh a few degrees of freedom an^ remove from analysis the *'noIse" X 
gener^tQd by covariables that had proveh to be unrelated to test results In the 
first three MODELS, the list of covariables was reduced from 17 to nine as v 
detailed in the previous chapter, 

MODEL I Rerun: Effect of Demographic Coyariables on Test Results 

in this MODgL>\classroom scores on the reduced set of nine demographic 
and pre-test covaria)3leti described earlier were'subjected to multivariate 
regression analysis on three dependent postr test classroom scores with the ' 
fallowing results: ' . • , 

(1) Proportion of test variance Accounted for by the list of covariables 

■ •■ • ■ •,, : ■ ■ ; -tifrv' 

Test Percent Variance 



3D .769 
4A- ' ' V ' .657 

•psi . \ ■,^661 : 

(2) Tests of Hypotheses (stated In terms of the null, hypotheses and 
their levels of rejection). 

(a) Hy pothes itXV ; That the cQvariable as a unitary set have no ' 

. :_JJ:eff0ct on4he^test-resuUs as a unitary-set, — — - - — 

^ " ^ N = 121 classj:*ooms 

' df - ^7/319 . ■ " 

-F - 14.17/' • V- ^ . . . 

p .< ,001 

(b) Hypotheses 2 - 10; I'hat the covariables conlldered separately 
hai^e no effect on the test results as a unitary set, 

N = 121 classrooms 
' df,r 3/109 • . . 



J 




Covarlables 



1; Mean age of children In months 

2, Percent having previous preschool 

3. Percent English first language ' 
'4. Percent non-White 

5, Mother *s^educa^lon level j 
6* ' Mean totkfsD pre-score 

Mean total 4A pre-score ? \ 

8. Mean total PSI pre-score 

9, 'Njimber of valid pre ^nd post PSls 



4; 00 



2,95 
-3,74 
8,69 

32.41 
3,21 



^ (c) ^ Hypotheses 11-- 37v ^^^^ T^^ the coviarlables conslde^^ied separftl!|l 
' ^ have no effect on the test results cpnpJderbd separately. ^ 

' N = 121 classrodttis • 
; ^ : df f 1/lii i 




Covarlables 


' 3D 




.;,/• . 4A 


P< 


PSI 

F 


■4 ■ ■ 


^ 1. Mean ag^. ofvShlldren In 
/ . months ^ ^ : ^ 


9,06 


.oi; 




NS • 


9.50 


,01 

* ■ • ■ * 


2»;]^ercenthavlng^adpre^^^^ 
preschool \ 


-\ 


NS 


3.01 




3.46 


.1 


3* Percent English first language 




NS 




.NS 




- NS 


. 4. Percent non-white , , 


4.35 


.05 


,5.83 


.05 


' 3.40 




' 5. Mother^s, education level 
6. Mean total 3D prerscore 


4.36 


.05 




NS 


11.26 


,01- 


21,74 


. 001 


NS 


; 2.83 


.1 


, — 7. Mean total 4A pre-*scora 




NS 




NS.j 




NS ^ 


• *^;'-8. Mban total PSI pre-score 


6.33 


,05" 


40. 54 


.061' 


57i42 


.001 


- 9, Number of valid pre and 
• .post PSIs . 




NS 


6. 73 

• 


.05 


2.94 





ERIC 
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MODEL II Reriint Effect of Inipletiient^tlon yariables on Test JResalts i 

In this MODEL, the classroom scores on* the 24 Implementation vaHabJes 
were added id the c6\^arlables us$d Ih NIODEL 1 r^rim ahd subjected-io multi- 
variate analysis with th^ mean cl^tssrooni post scores on the three dependent 
.tects: * . ' : . : / i I - 

The results are as^follow's: ' • / . " ' 

(1) Prpportloh of test variance accdunted for by all variables* . • 

Test * : Percent Vadanco ' . 

— . , ^ --r— ■ 1 ^ , ■% 

: ^ -/^ 3D. . ^ - ,■',■>■:■ . ,,829>-.^ ^ 

(2) Test df Hypotheses (stated as null hypothe&es-and their levels ot \ 
re5ectl6n>. . ' V / * ^ > . . 

(a) Hypgthesis I; That th\3 covarlables as a unit haye no effect on 
' the test scores as a unit* / ^ 

V : N = 121 ^oiasis rooms 1 v ^ 

, ^ ^ df - 27/249^ ^ . 

^ : ' V . F = 9,12 V ^ ; ^ 

p < .001 / ' . 

■ ■■ ■ . \ ■ • ' ' ■ - ■ ' -^^ " 

; / (b) Hypothesis 2; That the iriiplenientatlon variables as a utiU haye 
no e£fect on the tie'st sc6re$ a& a qnit, 

* ^ N = 121 classrooms ^ > ^ 

' ' df ^ 72/255 ^ . " 

F 1.77 , ^ ' 



, ^» p^ < . 



PV < .91 ^ . 

•(c) Hypotheses 3-11 ; That the covarlables considered separ^ite^ly' 
have no effect on th$ test res.ults as a unit^ ^ 

^ ' - ' \ . , 

N = 121 classrooms 

df > 3/86 ' ' ^ 



V . 220 



IVtdati age of cfilldren In months ? . 
Percent having had previous preschool , 
Percent English first language . ^ . 
PjOrcent nbh-whlte > ; 
Mother^s:edvuiatton (eveV » 
MeantptalS|)pre-$Odre^^;^^^^^ " 
Mean total 4A pre-score ■ ' . 

8. Mean total PSI pre-scoro • ' 

9. 'Number pf valid pre iahd post PSIs 



1^ 

I'.: 

3. 

4. 
5. 
6. 
7. 



2.74 



2,72 
4.83 
.6.93 

;6;62 



.1- ^ ^ 

.001- - 
.OOl^i 



(d) Hypot heses 12 35: That the 'implementation variables 
. considered separately have no effect on the test results as 
■ unit; ■ 



N == 121 classrooms 
df = '3/85 



Implementation Vai-Iables 



6. AduU/chlld, ratio 

10. Groui) tlmOj sharing, rest, story, etc. 

11. Numbers, alphabet, -reading ; • 
13, ' Games,* puzzles ' • . 

20. AduU with one or two children, academic activity 

21. Adult with small group, academic activity 

24. Wide range'of activities i 

25. Independent child activity 

26. Adult with one or two children 

46. Adult diirfect question, child response, adult *^ 
' corrective "feeiiback , 

.47. Adult direct question, child response, adult 
acknowledgment , 

•48. Adult direct question, child response, adult 

' praise 

49, Adult open-ended question 

• 52, Adult praise to child 

53. Adult acknowledgment 



5.11 



2.32 
3.69 
3.84 



'■ ^^'^^ 

,1 V's 

.05 

,05 :™. 
-NS 

NS . 

NSI73 

NS - ' 

i-^-'NS 



\tlfe 



. iniplenxentatlon Variables 




P'< 

— ■ ■ ■ - • 1- 


^ .o*** /\auu ppsiiive corr6ciiv><g/i66QDacK 


i2; 57 


.1 


cnfiia soiiTinsiruciion 




XTO 

;NS. ^ 


u^* Aouujnteraction \vivn one or two Q^n 




• NS y ■ 


Do# Aouit interaoiion wLtn stnaii group 




NS 


Oil, v>nuci initiates interaction witn adult 




NS . 


70. Child initiates Interaction with other children 




NS . 


; , 71; Child non-verbal . . 




NS 


72/ Child cooperates >*lt^ other chlidreri 




NS 


8l. All motion 




NS 



• (e) Hypotheses 36 - 62: That the covarlablejf consldereid separately 
have no effect on the test resutis considered separately, 

— ' ■ .» ' ' - ' ■ ' , ■ " . ■• ■ 

' : N = 121 classroomis 

— . , ^ df ? .1/87 . 



Xovarlables" 


3D 




4A 


-P < 


. PSI 

— F — - 


• 1 - ■ 


1, Mean age of children In 
months- . 


2.60 


NS 




NS 


5.93 


.05 , 


2, Perc.ent having had previous 
preschool - ; 




NS 




Nsr 




NS , - 


3. Pef cent English first language 


MM ' 


NS 




NS 




NS -". 


4,. Percent non-white- 


8i"25' 


-•01 




NS 


3.44 


.1 . . ■ ., 


st Mother.^8 education level 




NS 




NS 


13.23 


.001 *" -'' i 


6, Mean total 3D pre-score 


20.02 


. . 001 




NS 


8.98 


.01 ' V 


7, Mean total 4A pre-score 




NS 




NS 




NS - V 


8, Mean tot^l PSl pre-scdrfe . 


3.49 


.1 


24.09 


. pDl 


' 29.57- 


.001 


9. Number of valid pre and ' 
post5§l8 




J4S 


3^69 


.1 




NS ■ ' • 



(f) Hypotheses 63 - 134; that the Implementation variables 

considered separately have no effect oq the test results Considered 
^ separately. • . 

'■ • . * ■ ■ ' ^ 

N ^ 121 classrooms / 
df = 1/87 . . 
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ERIC 



■ f . 

Implementaflon Variables 


3D 




4 A 

F 


P < 


PSI 

F 


p< 


6. AdiiU/child ratio 




NS 




NS 




NS 


10, Group time, j^haring, rest, 
story, etc. , * 




NS 




NS 




NS 


11, Numb6rs, alphabet, reading 




NS 


.4.25 


-.05 


8.'40 


.01 


13. Ga^es, puzzles 


" 3.26 




4.33 


.05. 


■ 2.83 




20. Adult with one or two child- 
ren, academic activity ^ 




NS 

• 




NS 




NS 


21. Adult with small group, 
acaoemic accivicy • 




NS 




NS 


4.74 


.05 . 


24. Wide range of activities 


8.95 


.01 


6.70 


.05 




NS 


25. Independent chltd activity 


. 8. 81 


.01 


^ 6.69 


-.05 




NS 


26. Adult with one or two children 




NS 




NS 




NS 


46. Adult direct question, 6hlld * 
rGspofiBo, dQULv correciive 
feedback 




NS 




NS 




NS 


47 Arliilf rifrppf niipsfinn phild 

response, adult acknowledg-j 




Nf? 




NS 




NS 


— r — ment — - 







• 






- /'•, 


48. Adult direct question, chltd 




NS 


. — — 


NS 




NiS 


49. Adult open-ended question 


4, 12 


.05 


— * 


NS 




NS 


52. Adiilt praise to child 


■ — — , 


iNS 




NS 




NS ' 


53, Adult acknowledgment 




•NS 




NS 


r . 

■4.85 


NS 


54. Adult positive corrective 
feedback 




NS ' ■ 




NS 


.05 

• 


59. All c^lld self-fnstructlpn 


— 


NS 




NS 





NS 


62. Adult interacti6n with one 
or two children * / 




NS 




NS 





NS * 


63. Adult Interactlon'wlth small 


0 — - 


,NS 


■■ i , 


NS 




NS 


group 














69. Child initiates interaction 
with adult 




NS 


mm » 


NS 




NS 


70. Child initiated interaction 

with other children ^ 




NS 


3.31 


.1 




NS 


71. Child non-verbal 




NS 




NS 




NS 


72. Child cooperates with 
other children 




'NS 




mi 




NS 


81 • All motion . ' 




NS 




NS 




NS 
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MODEL III Rerun; Effect of 'Other Process Variables on Test Results 



In this MbDEL, classroom scores on the nine general interest variables. 
w6 re added to tho^o of the covariables arid th6 implementation variables for 
muitlvarlate analysis with the classroom scores on the three post tests, as- 
depehdent variables • Tbe results are as follows: ^ 

(1) Proportion of test variance accounted for by all' variables (r2). 

Test Percent Variance 

' • 3D ' .837 

, 4A ^ .808 . 

(2) Tests of Hypotheses (stated In ternis of the null hypothesis and their 
levels of rejection), ^ / p 

(a) Hypothesis 1 ; That the covarlables as a unit have no effect on 
the test, scores ais a unit. ; 

N = 121 classrooms . 
df =27/223 

,001 ^ -y-'/ 

' ; ^ (b) Hypothesis 2; That the Implementation variables as a unit have 
no effect on the test variables as a unit, ^ • 

/i N =^ 121 classrooms 

• / , df - 72/228 . • 

'■■■'■^■'A:^^:^ //v'v^- ■■^:< . ... 1-; i 

/ fc) Hypothesis 3; That the general interest variables as a unit have 

/ lib effect as a unit. - . 

/'^^M^^^^^^^ \ ' \ V. ; ' - • _ 

V N = 121 ciassroon\s 

. ^ 27/223 • : 

\. F = 1.37 , 

- X .1 ' : . 

(d) Hypothe8eB,4-- 12t Th^t the covariables cortsidereci separa^tely 
haveHo effect oh the test, results considered as a unit^ ^ . 

- ikl classrooms 
df =5/76 * 



Covarlables 



F 


P< 


mm 


NS 


m m 


, NS. ■ 


mmt 


■ NS . 


2.17 


.1 


4.81 


.01 , 


6.56 


.01 : 


mm 


NS 


12,56 , 


,001 




NS 



1. Mean age of ohlldrcfn Ift months 

^Percent haying had previous preschool 
»3. Percent English first language 
4, Percent nori-^lte ^ . : 
5^ Mother's education level ] 
6,. Mean total 3D pre-score 

7. Mean total 4A pre-score 

8. Mean total PSI pre-score 

9. Number' of valid pre and post PS Is ' 



(e) Hypotheses 13 - 36: that the implementation variables consl- 
dered separately have no effect on the test results considered 
as a unit. ^ ^ . 



N ^ 121 classrooms 
df = 3/76 . 



Implementation Variables 



6. Adult/child ratio , 

10, Group time, sharing, rest! ^story, etc/ 

lit Numbers, alphabet, reading 

13, Games, puzzles * 

20, Adult with one or' two children, academic activity 

21. Adult with small group, academic activity 

24, Wide range of activities 

25. Independent child activity ' : ' 
26.1 J\dult with one or two children 

46, Adult direct question, child response, adult 
corrective feedback 

47, Adult direct'C[uestlon, child response, adult 
acknowledgment . ' 

48, AduU direct question, child responiste, adult . 



49/ i^dult 6jy6H^^^ question - 

ISSB^ ^^^^^ ledgment ^ ' 
v^^t^^^^^ dor reef ivefeedbaek 



2.31 



2.87 



2.24 



2.27 



a 

NS 
NS 
NS 
NS 
NS 
NS^ 
,05 
NS 
NS 

;i 

NS 

NS 
NS 

Ti ■ 



Implementation Varlablls 



P< 



59, All child selfTlnstructlon 

62, Adult Interaction with dne or two children 

63V Adult interaction with small grbup 

69. Child Initiates interaction with adult V 

70». Child initiates interaction with other children 

71. Child non-verbal 

72, Child cooperates with other children 
Si. All motion 



NS 
NS 
NS 
NS 
'NS 
NS 
NS 
NS' 



(g) Hypotheses 37 - 45; That the additional process variables 
considered separately have no effect on the test results 
considered as a unit. ' , 



Addltlogal Process. Variables 



N = 12l!Classrooms 
df = 3/7| 



P< 



14i Activity crafts, cookings sewing, 
pouridih^,^ of sawing) v ' 

23. Academic activity groitplngs . ' f 

27. Aide's participation in academic fotlvltiejs 

^0.- Child ^sponse to adult choice ^ri^quest ; 

60. Child asking questions of adult§ ^ 

61. Chlld^self expression, general ibomments 
80. Child Interacts with machine 

82. All positive behavior 

83. All negative behavior 



2.43 



2.72 



NS 
• 1 

NS 
NS' 
NS 

.1 

■ NS 

Ns' 



(h) Hypotheses 46 ^ 72; . That the coyarlables . considered separately 
have no effect oh the test ^scores considered s6paifitely, 



N =. 1^1 Class rdoms 
df , 1/78 • 
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Covairables* ^ 


3D 




4A 

F 




PSI 

F 


P < 


i 1. Irtean age of children In 

months . • ; , 


— - ■ 






NS 


4.07 


.05 


2i Percent haying had previous 




Ns; 


1 \ 






NS 






no, 




no 






4i Peijcent non -white . . 




Ait 




MC 


A Q*? 
4» O f 


• UD 


&, Motner s education levei 






o»oo 


1 






6. Mekn total 3D pre-scpre ^ 


15.86 






NS 


7; 56 


^01 


?• Mean total 4A pre-score 




NS, 


3,20 


.1 




NS. 


8. Mean total PSI pre-seore 




NS 


18.50 


.001 


23.31 


.001 


9» Number 'of valid pye and' 
post PSIs 








NS 


3.05 

t 


.1, 



0) Hypothesee 73 -144 ; That the. implementation variables 

considered separately have no effect^on the test results considered 
separately. . * ^ 



N = 121 classrooms 

'df ^ 1/7^-^^ .' . 



Implerneiitatlon Variables 


V 3D 
F 


P < 


. . 4A 
F 


P< 


PSI 

' F 


[ 

P< 


6. Adult/child ratio ^ 


6.63 


.05 




NS 




NS. 


10. Orou^ time, sharing, . rest, 
story, etc, ' 


««* • 


NS' 




NS . 




NS 


11. Numbers, alphabet, reading 




-NS. 




NS' 


2.81 


.1 


13i Games, Puzzles 




NS 




NS 




NS 


20. Adult with one or two children, 
* academic, activity ^ 




NS 




NS 




NS 


21, Adult with small group, 
academic activity 




NS ' 


V. , ■ ■ . ■ 


NS 




,NS ' 


24» Wide range of activities 


3.^0 


.1 . 


■w Ml : 


NS 


mmm 


N^ 


25, Independent child activity 


6,35 


.05 


4. Si 


.05 




%: 


26,'^^Ayutt With one or two ^ | 




■NS 




NS 


■ '■ mm 


NS' 


'46i Adult (lireet question, phlld 
response, aduU borrectlye 
feybacic 




NS 

« 


.. mm . 


NS 

1 - . 


mm' 


NS 



Impletnetitatlon Vatlables 



47 • Adult direct questlonv child 
response j adult ' \ 
ackno^yledgmeht ^ ^ i 

48; Adult dlreQt question, child* 
response, adult praise \ 

49, Adult open-ended question 

52, Adult praise to child 

53, Adult acknowle(Jgment. 

54, Adult positive corrective 
feedback' 

59. All chlld'self-Instructlon 

62, Adult Interaction with <ine or 
two children ' »/ 

63, Adult Interaction with small 
group 

69. Child Initiates Interaction 
with adult ^ 

70, Child I^hlUates interaction 
. * with ot|ier children 

71. Child non-verbal . 

72, Child cooperates with other 
children 

81. Alt motion 



3D 



2.92 



p< 


■ 4A 
F 


P< 


PSI 




■1 . 




NS 




NS 


NS 


2.70 


^ ■ . ■■■■ 

■-NS-;;' 




NS 


NS 




NS 




NS 


NS 




■NS ' 




NS 


NS 
NS 




NS 
NS 


3.42 


NS V 
, 1 


NS 


2,80 


.1 




NS 


NS 




NS 




NS 


NS 




NS 




NS ., 


NS- 




N^- 


— M 


NS ~ - 


NS 




NS' 




■ NS 


NS 




NS 




NS. 


NS 




NS 




NS 


NS 




NS 




NS 



?N= 121 classfoomfe 
af - 1/78 



-AddUIonat Process Variables 



14. Activity F (arts, crafts, 
cookLng, sewing, pounding, 
or sawing) / 

23. Acaddmic activity groupings 

27» AldeM participation In 4 
academic activities 

50.^ Child Iresppnse to adult ' 
^ :^ choicelret^Uest 

GQ) -Child aWing questions of 
adults *^ ' 

61. Child self-expression, 
ger|oral pomments. 

80. Child tnfieractB with 
; miachlne 

82. /All positive behavior 

83. All negative behavior 



[) , ■ 
p< 


4 A 

F . , 


P< 


PSI 

F 


j)< 


NS 


3.66 


.1 


— " 


;:ns 

y. 


NS . 




NS 


2.96 




NS 




NS 


- /' 


NS, 






NS 




NS 


•NS 


■ -/ 
/■ • . 


NS 




NS 


. NS/ 


. 3.40 


.1 


- JJ ' ■ 


NS 


/?JS '. 




NS 


f _ 


k 

NS 


' NS 




NS / 




NS 


NS 




Ns/ 


' \ '/ 


.1 



MODEL IV! Effect of GlobaV Factors pn Test ResqHs /. 

In this MODEL, classroom scor^^s oh the seven factors resulted fromjhe 
previously described factor analysis were combined with those on the nln6 
covarlables and subjected to multivariate analysis with classroom scores on 
the three post tests as dependent variables. The results are as followsf^ 

(1) Proportion of test score varlahcq accounted for by the covarlabtes 
• ■ and the factors (R2), / , 



Test ^ 


, Percent Variance 




3d 


V: .775- ■• 




4A 


• . 4 .730 ■. 




PSI 


', .670 ■ , 





(2) Tests of hypotheses (stated In terms of the null hypothesis and their 
; . levels of rejection), - *4t* , \ 7 

X (a) Hypothesis 1; That the coyarlables as a unitary set have no 
■ effect on the test results as a unitary set, ^ 

/ N =121 classrooms 

;df = 27/299 

■ - . - ' F:. 12, -20"' ^ / ^ • 

• p < »obi 

(b) Hypothesis 2; That the factor scores as a unitary set havb no 
effect on the test results as ;a unitary set, ^ 

N = 121 classrooms 
/ df 21/293 ; 

F ^.2,75 ; , 

p < ,001 • 

(c) Hypotheses 3 - 11: That the cpvarlables considered separately 
have no effect on the test results as a unitary set, / 

N =121 classrooms 

* - 3/102 ' . . 



i 



IV Mean age of chUdren in months 



■■ r ■ ■ 


P< 




.05 




,05 




: NS 






ft 49 


.01 . 


^ 6. 86 


..QOl 






22.49 


. 001 




NS 



■ M 



2, Percent havihg.had pi?evlous preschool 

j 3, Porcent English first language 

4» Percent n^^ 

5. Mother's education level 

8i Mean total 3D pre-score ' 

7, Mean total 4A pre-score 

. :8i Mean total PSI pre-score 

, 9. Number of valid pre and post 'PSis 



(d) Hypotheses 12-18; That the factors, considered separately 
have no effect ori the tesi results as a unitary set. 



N 
df 



121 oiass rooms 
3/102 



Factors • 
1. Programmed acadetntc instruotlbn 



P< 



2. Individual children In a wide variety of 
activities . 

3. Adult feedback to children ^ 

4. Positive Choice request interaction 
5'? Negative behavior 

6. Ppsltlve behavior 

7. * Adult with lar^d group 



4.58 



6,31 
2,49 



2.50 



.01 • 

NS 

.01 

.001 

.05 
(neg) 

NS, 

.1 ' 

(neg) 



mjp^^^^ o» tiiefi^ factor's scored elgnlficantly lower 



iERjciiSiiiiil: 



(e) Hypotheses 19 r 45; That^he covarlables considered separately 
have no effect oh the telSt results considered separately* 

^ * ' ^- ^ . ■ 

N - 121 classrooms / 
. . df 1/104 . . - ' 



novariflhlps 


3D 

P 




4fi 

p 


H< 


PSI 

F 


V < 


1. Mean ace of children In " 
- months 


5*35 






NS 


8-52 


.01 


2v Percent having had previous 
preschool / 




. NS 


6.40 


.05 


4.09 


,05 


3. Percent English first 
language 




NS 




NS 




NS 


4/ Percent non-vvhlte : 




•.NS ■ 


4.30 


. .05 




NS 


5. Mothej^^s education level 


3.86 


.1 




NS 


16,25 


.001 


6/ Mean^total 8D pre-score 


•^15.66 


.001 




NS 


4.8'5 


.05 


7. Mean total 4 A pre-score . / 




-NS 




NS 




NS 


8. Mean totatPSIpre-score 


8,39 


.01 


31.57 


.001 


44.15 


.001 


9, Number of valid pre and 
post PSIs 




NS 




NS 




NS 



(f) Hypothbses 19 - 39; That the factors considered separately 
have no effect on the test results considered separately. 

N - 121 .classrooms „ * • 

df *= 1/104 ' 



Factors 



3D 

F p< 




PSI 

F p< 



NS 

NS. 
.05 

NS 
"NS 



1. Programmed academic 
' ■ Instruction 

2i Individual children In a 
wide varfedy of activities 

■ 3, Adult feedbJ^ck to children 

4, Positive^ choice request' 
Interaction \ 

5? Negative behavior 
G. Positive behavior 

■ • ,. * * 

7f Adult with large group ' 



0.648 
0,225 



6.3.51 

0.166 
0.S4O 



NS- 
I^S 

NS 

NS; 

Ns' 

NS, 

Ns 

X 



0.566 

' (ne'g) 

0,46s 

5.77; 
(neg) , 



1.50 

0.916 

i.44 
4i60 

3.37 
(neg) 

4.19 

o.se'd 

(neg)»; 



* *ib'^^||oj^;N||Uh scores 'ori thesV factors Vcored slgfllfleafttrf*t^g|c' 



Comment and Discussion 



Inasmuch as factors scb res were uised to some degree as criteria oh which i 
to^evaluate sponsor programing plpinentatloni it Is Incumbent In a thorough > 
arikly^ls to assess the effect of factors on child test performance. The results 
of the analysis of this model clearly show that several of the factors are Indeed 
related to t6st performance. oYthe seyeo factors, five show some relationship 
and four are significant at p \< . 0^. This result Is In distlfict contrast with the 
analysis of Individual varlablW also used to assess model Implenientatlon that ll 
showed little more than rat^dom. effects between the 24 designated. variables 
and the test results. A 

Althougl} the use of factors and factor scores Is frequently criticized be- 
cause of their nebulous, and" non-speqlflc maturo as opposed to individual p 
variables, It apoears that they may be more useful In some situations In de-* 
scribing and evaiuattng sponsor goals In terms of desired *'atmo^f)here" 
characteristics of their classrooms, teVtainly, It seems that many of the 
sponsors fn this sample would be better able to state tlielr goals Imterms of 
global atmospheres than In terms of specific variable frequency. Unfortunately , 
since a classroom atmosphei^e represents some soiet of ongoing gestalti tt Is / 
patently Impossible to measure,the;*'frequenoy rate of Its occurrence^' as an 
observable variable. Such a measurement can only be obtained through some 
weighted combination of variables is Is represented by the use. of factors and 
classroom scores on factors, g / . 

MODEL V; Effect of Level of Implementation on Test Results 

This MODEL contrasts the effects of vClassrootAs withth sponsors rated 
a^ highly Implemented wlth those rated as poorly or less well implemented, : 
ori the test results as dependent varlabje. The covarlables are Inotuded In 
the analysis for the effect of providing ''adjusted'* ,test outcomes. The analysis 
results are as follpwsj . - 

Pcoportton^of test variance accounted for by the variables (R^j, , 
Since this MODEL Uses a highly restricted (47 classroorns) sample 
of the "hlgh^i and l4o\v't Implemented classrooms withlti seven sponsors 
and since th^ eight contrasts are represented in the 
*'dumttiiy*? variables, the R^ measurements are not meaningful and 
were not . CQmputed, ' ; ( 

Test of Hypotheses (stated In terms of the null and the sIgiStflcance ; 
levels of Its rejection), - 

' " • . , • ... I ' ■ , \ . V ^ ■ 

(a) Hypothesis 1; That the covarlables as a unitary set have no • 
effecfpn the test results &s a unitary set, / 

" N ^1 47 classrooms ; 

df . f 127/79 ' 
' - F ^ U,54 ^ ^ ^ 

p- < ,o6v ' ■' ^ ■ • t ! : 



' (1) 



(2) 



(b) Hypothesis 2; That the high/low consirasts.as a unitary set 
. Bav^ no effeci on the test results- as asunltary set. 



N ^47 classrooms 
" df -^4/79 •* 
F ^ h36 

p' < •OS ' . f 



(c), Hypotheses 3-11: That the covarlables considered separately 
have no effect on the' test results as a unitary set/ - * 



N == 47 classl^ooms 
df ^ 3/27 ' ^ . 



Covarlables V ' v * \ ^ 


.N F ^ V '■ 


PS 


Mean age of cUlldren In months \ v 


■ (».».• . • 


NS 


2; Percent having hadprevlous preschool 


■ ■■■ ■ ■ ■■ ■ . c 

■^"^ , 


NS 


3. Percent English first language 


■■/.■• 


NS 


4. Percent^ nbn-whtte ' . 




NS ^ 


Mother's Education level 


3.01 


.05 


6, cMean total 3^ pre-score . 




NS 


7/ Mean total 4A, pre-score 


3.30.' 


■ ,05 


•8, Mean total PSI pre-score 


11.77. 


.001 


9\ Number of valid pre and post PSIs 


2.07. 


'ns 



(d) tfyRptheses 12 - 19:, Tliat the high/low contrasts cons l<Je red 
sepatalfi^^Jiave.no effect on the test results as a uoltary set. 



N * - 47 cia^sroorns 

df-^^--»y2T: 



ImplemehtaUoii Contrasts 




1. High/low classrooms, U Arizona' 

2. High/low classrooms, U Arizona 
3; High/low classrooms^ High Scope* 
4/ High/low classrooms, U Kansas 
6,v H Par West 



mmm^Mm-:^>^^SS$^0^M^ ^ lasjs rooms, KDC ''^f ; : ■ 
^^^;^#Htgh/low classrooms* U Oregon 



0.41 
0.86, 
5.15 
0.14 
/l.7.' 
■.•.;i.4^;. 

0.7' 

* .^.45 



P< • 



^^S 
NS 
.05 

NS^ 

m' 

NS- 
NS. 
.1 



(e) Hypdthefeeg 20 - 46; That each cbydrlable considered separately^ f-;^ 
has no effect on the test resultisi considered separately. 

N « 47 classrooms / ■r-'^^^^^^:— 

df = i/29 . / 



Covariables 


3D 

,F , 


P< 


' 4A 

F. 


P< 


- PSI 

..F ^ 




1. , Mean age of children In 
, months 


.4.07 


— ■ 




NS 




.Ns^:.---; 


2, Percent having had previous 
preschool 




NS 




NS 




»'NS^_ . 


.3. Percent English first . 
language 




NS- . 


— 


NS 




" NS . ..... 


4, Percent tion^whlte 




NS 




, NS 




'ns.!„_,.,. 


, 5. Mother's education level 


3.67 


.1 


4.12 


.1 




NS..^:;.-::: 


6, Mean total 3D pre-score 




NS. 


3.41 


.1 




NS. 


7. Mean total.4A pre^'score 


3.74 


.1- 


' Mb* 


NS 




.^S~^' 


8, Mean total PSI pre-score 


6.39 


.05 


22. 81. 


.001 


18.70 


.001 « 


9, Number of valid pre and 
post PSIs 




NS 


6.21 


.05 




NS 



(C Hypotheses 47 - 70t That the high/low contrasts conslderjed 

separately have no effect on ^le test results conside red separately *: 



N . = 47 classrooms 
df ^ 1/29 



Implementation Contrasts 



.1. High/low classrocmsi 

U Arizona 
'2, High/low d'assrooms, 

U ArUona 
3?' HIgh/lC)w classrooms I 

High/Scope , 

4. High/low classroomsi 
^ ' ' U Kansas . ' 

5. . Hlgfi/low*clas8room8/ 
, : > :fdf :^^^ , ' 

6. flfgh/low classrooms,, 

^ . J^IKJ \ 

7i Hljgh/low classrooms, 

l9t»'T^HIgh/tow dlass rooms, 
Bank Street 



3D 



4,46 



4.89 



P< 



NS 
NS 

«► 

.05 
(neg) 
NS 

NS 

NS, 

>JS ; 

.05 
(P08) 



4A 



P< 



NS 
NS 
-NS 
NS 
NS 
NS 
NS 
NS 



F 



12.55 



St 4.35 

* * 

4^24 

. \ ■• 



P< 



.NS 

Ns~: '-^ 

, oof-T' 

(neg). 
NS 

NS . - - " 
.05^"- 



.0$ 

(P6b) 



mm 



>TK<? :tfegaiHy6 i-elfiflonshlp 16 caused by the lovv Implementation classrooms ^ — 
: ^fftbl-ififill'^^^t obtaining significantly hlghey t^t sccres.. ; : ; Iv^ iV; . W • 



MQD£L:VirCo1itrast of Py and NPV Effects on T66t Results . vV j 

In this MODEL, the effects of classrooms ^yUhIn PV (I.e. ^ In spon||^red 
pr6grams}^^re contrasted with those In NPV classrooms (I.e, , unsponsored) on 
test* scores as dependent variables given the effects of the cova,riables, J^The 
results are as follows: < . \ 

■: . . ■ " ■ , . ^ ' • '•; ' : ■/ ■'■ ' ^^ 

{1) Proportion ofthe variance? accoulitecl for / 'In this MODELi a dummy 
, variable Avas used to represent the contrast between PV ahO NPV; 
Since the R^s would iiot be meaningful ^ they were not computed. 

(^) ^ests of hypotheses (stated In terms of the null hypothesis and the 
? probability of rejection thereof), ^ , 



(a) H 



Is 1: V That the covarlables at'a unllat7r have ho 



effect on the test results as a unitary set. 



N ^ 121 classrooms 

df - 27/316 

P • = 13.99 

p/ < .001 ^ . 



II 



■ERiL. 



(b) >„ Hypothesis 2: Thdt the PV/NPV c.ontrast has no effect on the 

test. rfesu Its as a finitary set. , 

~/ N = 121 classrooms 

/ df 3/108 ' 

: : . # ^ ^ P ^ 0/80 - 

■ ; ■ , ^ p NS ^ . ' ' , 

(c) Hypotheses 3 - II ; That ihe covarlables considered' separately 
have no effect on the lest results as a unitary set. / 

N = 121 classrooms ♦ ' 
Jl' / df =3/108 



Covarlable 



1. Mean age of children In months 

2. Percent havlngliad previous preschool \ 

3. Percent English first language, 

4. Percent noh-white 

5. Mothe'r^s education level 

6/ Meaji:tQtal^3D pre-score ' 

7. Mean total 4A pre-scpre 

8. Mean total PSI pre^score 

9. Number of valid pre anc} post PSIs 



iiiilli 



F ■ • 


P< 


3.65 






NS 




NS 


< 2.92 


.05;' 


.4.03 


>n 


: 8*69 


.001 • 




NS 


32.08 









^ (d) Hypotheses 12^ 38 i That the covfirlabies considered separately 
have no effect on the test results considered separately. 

1^ /== 121 class roon^s > / 

e • df - 1/110 ' ' , / 



Covarlables ' ; ^ • *^ 


3D 

■ ■■■X .. ■ ■■ 


11 *> 


• 1 4A 


P < 


PSI 


P N 


1- Mean iacrd of childri^ti In 
months 


O • OX 


/ 






ft flQ 


A1 
• ^\ 


2w Percent having had previous 
preschool. ' * 




/ 




NS , 


/• 4.35 


.05 


3, Percent English first ^ 
language 




/ns ' 


■ 7"" . 


/ 

/ 




NS " 
• 


4, Percent non-white 




.05 


.5. 83' 


.05 


3.39 


.1^ 


5. Mother's education level 


4.82 


.05>> 




NS 


12.10 


.001 


6. Mean totaK3D pre-score 


21.67 


.001 


/ ■ 


NS 


2.81 


.1 


7, Mean total 4A t^re-score 






/ ' ■ 


-i^^s' 




NS . 


8. Mean total PSI pre-score 


6,54 


.Of 


39.83 


^001 


- 58.23 


.OOl 


9. Number of valid pre and 
post PS Is 




■ NS - 


6.74 


.05 


2.92 




(e) Hypothesis 39 - 41j That the PV/NRV contrast has^ no effect on 
. the test scores considered separately* / 


Contrast 


3D 

F- 


P < 


4A 

F 


P< 


. PSI 
F 


p< 


1. PV - NPV ' ; 


0.87 

1 


NS 


0.99 


NS 


1.23 , 


NS 



iiliiililiii 



iiliiiiSililiilR 
-ililsilliliaS^^ 



